-- Logs begin at Sat 2022-08-06 20:01:15 UTC, end at Sat 2022-08-06 21:02:33 UTC. -- Aug 06 20:34:55.941289 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 06 20:34:55.951006 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 06 20:34:55.953032 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 20:34:55 2022] *** Aug 06 20:34:55.953032 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 20:34:55.953032 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 20:34:55.953032 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: nodename: dv-osbrick-master-4-ceph Aug 06 20:34:55.953032 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: machine: x86_64 Aug 06 20:34:55.953032 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: clock source: unix Aug 06 20:34:55.953032 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: pcre jit disabled Aug 06 20:34:55.953032 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: detected number of CPU cores: 4 Aug 06 20:34:55.953032 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: current working directory: / Aug 06 20:34:55.953032 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: detected binary path: /usr/bin/uwsgi-core Aug 06 20:34:55.953032 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: your processes number limit is 47680 Aug 06 20:34:55.953032 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: your memory page size is 4096 bytes Aug 06 20:34:55.953032 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: detected max file descriptor number: 2048 Aug 06 20:34:55.953032 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: lock engine: pthread robust mutexes Aug 06 20:34:55.953868 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: thunder lock: enabled Aug 06 20:34:55.953868 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 06 20:34:55.953868 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 20:34:55.997838 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: Python main interpreter initialized at 0x55b6b54459c0 Aug 06 20:34:55.997838 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: python threads support enabled Aug 06 20:34:55.997838 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: your server socket listen backlog is limited to 100 connections Aug 06 20:34:55.997838 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: your mercy for graceful operations on workers is 90 seconds Aug 06 20:34:55.998184 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 20:34:55.998260 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: *** Operational MODE: preforking *** Aug 06 20:34:55.998488 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: *** uWSGI is running in multiple interpreter mode *** Aug 06 20:34:55.998488 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: spawned uWSGI master process (pid: 93743) Aug 06 20:34:55.998722 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 06 20:34:55.999716 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: spawned uWSGI worker 1 (pid: 93751, cores: 1) Aug 06 20:34:55.999716 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: spawned uWSGI worker 2 (pid: 93752, cores: 1) Aug 06 20:34:55.999716 dv-osbrick-master-4-ceph devstack@keystone.service[93743]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 20:35:01.589636 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:35:01.589636 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: from cryptography.utils import int_from_bytes Aug 06 20:35:01.590481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:35:01.590481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: from cryptography.utils import int_from_bytes Aug 06 20:35:01.590918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:35:01.590918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: from cryptography.utils import int_from_bytes Aug 06 20:35:01.591036 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:35:01.591036 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: from cryptography.utils import int_from_bytes Aug 06 20:35:01.639128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 20:35:01.639320 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 20:35:01.639460 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] command line args: [] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 20:35:01.639701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 20:35:01.639834 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 20:35:01.639920 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 20:35:01.639986 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ================================================================================ {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 20:35:01.640049 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] command line args: [] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 20:35:01.640112 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] admin_token = **** {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.640324 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 20:35:01.640444 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] config_dir = [] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.640530 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ================================================================================ {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 20:35:01.640592 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.640729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] config_source = [] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.640872 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] admin_token = **** {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.640956 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] debug = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.641031 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] config_dir = [] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.641091 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.641319 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.641319 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] config_source = [] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.641434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.641491 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] debug = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.641671 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.641750 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.641834 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.641893 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.642015 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.642088 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.642294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.642409 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] list_limit = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.642475 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] log_config_append = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.642532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.642725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.642810 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] list_limit = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.642872 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] log_dir = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.642929 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] log_config_append = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.642984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] log_file = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.643115 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.643197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.643262 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] log_dir = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.643432 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] log_file = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.643549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.643616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.643674 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.643862 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.643952 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.644165 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.644288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.644372 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.644434 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.644505 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.644570 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.644635 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.644691 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.644911 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.645045 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.645137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.645199 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.645328 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.645406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.645586 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.645721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.645800 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.645873 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.645999 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.646082 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.646266 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.646463 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.646546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.646783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.646911 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.647046 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] publish_errors = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.647168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.647248 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.647395 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.647489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] publish_errors = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.647567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.647642 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.647815 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.647895 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.647971 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.648106 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.648216 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.648298 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] standard_threads = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.648459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.648547 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.648690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] standard_threads = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.648769 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.648919 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.648999 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.649068 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] use_journal = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.649180 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.649318 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.649397 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] use_json = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.649466 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] use_journal = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.649534 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] use_stderr = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.649616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] use_json = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.649692 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] use_syslog = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.649778 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] use_stderr = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.649854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.649953 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] use_syslog = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.650130 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.650241 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:35:01.650347 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.650441 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.650627 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.650746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.650871 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.650975 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.651126 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.651275 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.651353 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.651423 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.651597 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.651684 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.651830 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.651911 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.652078 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.652158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.652323 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.652401 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.652570 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.652650 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.652803 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.652881 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.653032 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.653110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.653270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.653350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.653500 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.653578 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.653741 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.653869 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.654022 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.654093 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.654197 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.654276 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.654454 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.654539 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.654726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.654819 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.654961 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.655040 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.655189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.655273 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.655439 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.655519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.655706 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.655792 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.655954 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.656038 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.656189 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.656271 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.656401 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.656475 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.656628 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.656709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.656853 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.656930 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.657082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.657166 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.657337 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.657423 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.657570 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.657647 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.657795 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.657869 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.658022 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.658105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.658268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.658343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.658504 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.658578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.658758 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.658849 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.659007 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.659082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.659233 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.659307 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.659466 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.659619 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.659694 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.659762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.659916 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.659997 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.660144 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.660226 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.660372 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.660451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.660599 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.660675 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.660842 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.660927 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.661070 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.661144 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.661306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.661381 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.661535 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.661618 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.661763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.661839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.661995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.662072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.662225 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.662307 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.662459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.662538 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.662709 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.662796 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.662941 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.663029 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.663172 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.663247 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.663401 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.663476 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.663631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.663718 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.663858 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.663934 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.664084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.664159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.664396 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.664530 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.664617 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.664816 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.664901 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.665089 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.665181 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.665321 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.665425 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.665561 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.665644 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.665795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.665873 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.666042 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.666119 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.666278 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.666362 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.666548 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.666647 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.666804 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.666932 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.667050 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.667128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.667289 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.667366 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.667521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.667597 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.667751 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.667834 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.667982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.668058 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.668222 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.668306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.668454 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.668531 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.668686 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.668761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.668920 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.669015 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.669152 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.669234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.669379 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.669454 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.669608 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.669692 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.669837 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.669919 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.670062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.670138 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.670318 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.670403 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.670554 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.670678 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.670817 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.670892 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.671049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.671205 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.671279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.671348 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.671500 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.671576 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.671729 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.671813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.671958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.672046 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.672183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.672259 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.672409 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.672485 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.672634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.672717 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.672863 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.672945 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.673085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.673161 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.673318 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.673406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.673548 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.673625 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.673790 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.673866 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.674019 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.674110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.674269 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.674344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.674525 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.674621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.674786 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.674873 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.675015 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] auth.external = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.675130 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] auth.external = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.675233 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.675327 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.675828 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.675967 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.676058 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.676131 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.676201 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] auth.password = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.676270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] auth.password = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.676345 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] auth.token = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.676420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] auth.token = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.676520 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.676598 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.676754 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.676833 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.676996 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.677072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.677226 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.677303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.677476 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.677560 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.677719 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.677795 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.677943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.678020 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.678176 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] credential.caching = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.678253 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] credential.caching = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.678418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.678495 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.678685 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.678767 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.678934 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.679023 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.679165 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.679247 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.679406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.679484 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.679633 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.679709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.679934 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.680011 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.680193 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.680271 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.680432 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.680632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.680710 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.680890 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.680975 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.681173 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.681250 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.681416 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.681493 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.681675 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.681811 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.681898 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.681972 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.682146 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.682227 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] federation.caching = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.682377 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] federation.caching = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.682470 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.682626 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.682710 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.682872 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.682962 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.683101 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.683189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.683328 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.683406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.683569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.683649 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.683821 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.683908 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.684044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.684129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.684271 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.684349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.684518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.684606 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.684749 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.684829 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.684981 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity.caching = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.685059 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.685208 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity.caching = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.685370 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.685449 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.685520 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.685681 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.685763 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.685912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.685991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.686138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.686216 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.686373 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.686451 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.686627 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.686710 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.686847 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.686927 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.687090 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.687170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.687320 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.687401 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.687548 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.687626 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.687773 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.687852 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.687997 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.688078 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.688233 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.688318 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.688473 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.688552 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.688713 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.688795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.688957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.689036 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.689197 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.689281 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.689451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.689530 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.689680 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.689758 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.689908 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.689986 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.690131 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.690213 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.690360 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.690438 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.690598 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.690690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.690839 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.690920 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.691077 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.691155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.691307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.691386 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.691540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.691621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.691767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.691846 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.692010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.692092 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.692242 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.692322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.692470 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.692549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.692715 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.692794 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.692944 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.693024 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.693182 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.693261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.693411 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.693490 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.693636 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.693718 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.693869 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.693950 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.694102 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.694183 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.694334 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.694413 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.694563 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.694662 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.694816 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.694896 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.695061 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.695142 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.695290 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.695368 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.695585 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.695673 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.695811 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.695958 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.696139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.696220 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.696396 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.696476 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.696631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.696718 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.696863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.696948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.697090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.697168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.697315 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.697394 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.697549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.697628 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.697794 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.697875 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.698019 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.698099 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.698261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.698341 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.698503 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.698619 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.698761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.698840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.698989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.699068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.699210 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.699301 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.699441 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.699526 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.699667 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.699745 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.699893 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.700003 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.700128 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.700211 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.700341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.700421 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.700582 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.700670 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.700823 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.700902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.701064 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.701148 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.701292 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.701379 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.701513 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.701591 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.701752 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.701831 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.701983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.702069 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.702208 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.702287 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.702436 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.702514 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.702684 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.702777 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.702923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.703004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.703159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.703237 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.703387 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.703473 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.703633 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.703712 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.703855 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.703940 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.704097 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.704183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.704325 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.704407 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.704553 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.704633 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.704785 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.704872 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.705023 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.705101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.705256 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.705363 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.705482 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.705580 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.705713 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.705793 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] resource.caching = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.705948 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] resource.caching = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.706027 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.706194 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.706290 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.706426 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.706504 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.706677 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.706760 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.706923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.707016 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.707154 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.707233 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.707383 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.707462 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.707624 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.707777 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.707854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.707925 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.708071 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.708150 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] role.caching = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.708300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] role.caching = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.708388 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] role.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.708528 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.708607 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] role.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.708751 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.708830 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.708994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.709084 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.709265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.709344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.709515 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.709594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.709769 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.709858 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.710043 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.710129 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.710288 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.710367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.710530 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.710623 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.710796 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.710876 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.711025 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.711158 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.711378 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.711460 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.711659 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.711789 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.711925 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.712005 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.712191 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.712350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.712606 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.712684 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.712858 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.712936 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.713130 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.713211 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.713385 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.713464 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.713632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.713715 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.713891 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.713972 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.714153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.714266 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.714421 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.714507 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.714691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.714838 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.714918 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.715142 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.715221 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.715416 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.715509 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.715657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.715736 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.715912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.715991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.716176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.716256 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.716422 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.716500 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.716655 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.716732 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.716889 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.716968 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.717115 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.717193 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.717346 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] token.caching = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.717425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] token.caching = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.717579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.717659 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.717822 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.717900 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.718052 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.718131 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.718303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.718384 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.718548 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.718648 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.718801 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.718879 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.719039 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.719119 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.719277 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.719355 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.719517 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.719594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.720088 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.720172 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.720324 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.720402 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.720551 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.720629 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.720798 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.720878 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.721041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.721119 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.721266 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.721345 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.721501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.721581 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.721788 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.721866 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.722043 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.connection = **** {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.722136 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.connection = **** {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.722281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.722370 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.722523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.722661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.722780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.722867 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.723015 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.723095 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.723244 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.723331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.723478 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.723557 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.723704 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.723782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.723933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.724020 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.724170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.724249 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.724398 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.724516 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.724637 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.724725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.724865 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.724945 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.725110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.725188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.725336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.725423 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.725574 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.725657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.725797 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.725876 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.726032 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.726123 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.726261 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.726338 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:35:01.726431 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 20:35:01.726509 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 20:35:01.755925 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.756136 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.756357 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.757008 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.757383 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.757781 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.765829 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.769316 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.795436 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.795644 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.796603 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.796836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.847589 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.847744 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.898042 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.898252 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.898369 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.898617 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.962410 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.962627 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.962874 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.962996 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.963091 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.963169 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.963275 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.963418 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.963541 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.963624 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.963837 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.964035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.986692 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.986923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.987152 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.987274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.987344 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.987536 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.987661 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.987744 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.987822 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.987931 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.988018 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.988151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.988384 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.988604 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.999022 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:01.999556 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:02.011780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:02.011997 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:02.012208 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:02.012455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:02.012580 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:02.012650 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:02.012848 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:02.012987 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:02.013056 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:02.013130 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:02.013284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:02.013508 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:02.013699 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:02.013941 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:35:02.029836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.030081 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 20:35:02.030388 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.030529 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.030644 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 20:35:02.030752 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 20:35:02.030842 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.031115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.031238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.031306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 20:35:02.031381 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.031570 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.031693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.031840 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.032091 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.032344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.041191 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.041471 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.041747 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.041911 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.042007 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.042227 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.042497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.042804 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.050687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.051475 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.053578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.053863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.054143 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.054401 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.054527 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.054679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.054772 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.055348 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.055473 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.055546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.055635 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.055713 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.055775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.055835 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.055894 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.056088 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.056190 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.056316 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.056441 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.056638 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.056911 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.057163 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.078967 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.079993 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.080432 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.080700 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.081466 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.081752 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.085211 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.085492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.085783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.086430 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.086745 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.087034 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.092418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.092704 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.093603 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.093893 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.097065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.097355 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.097660 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.097932 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.098298 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.098443 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.098558 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.098670 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.098881 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.099004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.099132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.099223 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.099554 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.099854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.100134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.100419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.115140 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.115406 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.116121 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.116390 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.119407 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.120400 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.122514 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.122830 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.123547 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.123849 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.127147 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.128185 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.130246 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.131326 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.133471 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.133762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.134044 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.134433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.134556 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.134736 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.134879 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.135000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.135089 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.135496 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.135786 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.136067 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.150764 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.151042 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.151316 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.151585 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.152048 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.152306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.152607 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.152879 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.158275 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.159639 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.159984 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.160268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.161332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.161612 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.162927 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.163216 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.163499 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.163788 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.164041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.164345 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.164664 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.165044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.165127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.165435 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.176395 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.176678 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.176954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.177229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.177460 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.177589 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.177690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.177767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.178005 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.178129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.178291 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.178568 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.178874 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.179150 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.193571 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.194687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.196648 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.197706 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.200583 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.201682 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.202030 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.203172 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.203531 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.203824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.204121 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.204665 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.204954 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.205245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.317216 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.318503 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.318677 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.320042 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.321976 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.322270 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.322538 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.322858 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.323055 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.323344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.323628 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.323910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.330753 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.331043 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.331324 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.331774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.332070 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.332352 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.338205 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.338613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.338905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.339179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.339304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:35:02.339460 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.339587 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.339733 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.339872 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.340016 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.340143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.340291 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.340418 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.340569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.340678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.340840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.340981 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.341060 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.341191 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.341336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.341420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.341601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.341684 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.341869 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.341952 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.342212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.342484 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.342773 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:35:02.375453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b6b54459c0 pid: 93751 (default app) Aug 06 20:35:02.376261 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b6b54459c0 pid: 93752 (default app) Aug 06 20:35:02.379007 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c38cb-f8e0-4d97-aada-d3733bdabacc None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:02.379293 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c38cb-f8e0-4d97-aada-d3733bdabacc None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:02.379569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c38cb-f8e0-4d97-aada-d3733bdabacc None None] PATH_INFO: `/v3` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:02.383817 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Sat Aug 6 20:35:02 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:10.705174 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1df6d1-fc72-455d-82c6-d3b83d1fad71 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:10.706136 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1df6d1-fc72-455d-82c6-d3b83d1fad71 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:10.706136 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1df6d1-fc72-455d-82c6-d3b83d1fad71 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:10.714212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:10 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:10.724726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d12d1-cdc2-46e0-adea-b5fc52f47e07 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:10.725203 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d12d1-cdc2-46e0-adea-b5fc52f47e07 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:10.725203 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d12d1-cdc2-46e0-adea-b5fc52f47e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:10.803373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: INFO dbcounter [None req-af3d12d1-cdc2-46e0-adea-b5fc52f47e07 None None] Registered counter for database keystone Aug 06 20:35:10.828496 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG oslo_db.sqlalchemy.engines [None req-af3d12d1-cdc2-46e0-adea-b5fc52f47e07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93751) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:35:10.839492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writer thread running {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:35:11.042168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG passlib.handlers.bcrypt [None req-af3d12d1-cdc2-46e0-adea-b5fc52f47e07 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93751) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 06 20:35:11.042617 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG passlib.handlers.bcrypt [None req-af3d12d1-cdc2-46e0-adea-b5fc52f47e07 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93751) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 06 20:35:11.114434 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-af3d12d1-cdc2-46e0-adea-b5fc52f47e07 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:11.117276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-af3d12d1-cdc2-46e0-adea-b5fc52f47e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:11.293889 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 570 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 06 20:35:11.447482 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1df6d1-fc72-455d-82c6-d3b83d1fad71 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:11.530892 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: INFO dbcounter [None req-ec1df6d1-fc72-455d-82c6-d3b83d1fad71 None None] Registered counter for database keystone Aug 06 20:35:11.556656 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG oslo_db.sqlalchemy.engines [None req-ec1df6d1-fc72-455d-82c6-d3b83d1fad71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:35:11.567625 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writer thread running {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:35:11.691748 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1df6d1-fc72-455d-82c6-d3b83d1fad71 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:11.697161 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a842c55-980c-4a8b-b6e8-83ed408c3d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:11.697862 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a842c55-980c-4a8b-b6e8-83ed408c3d21 admin admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:11.698137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a842c55-980c-4a8b-b6e8-83ed408c3d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:11.698402 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a842c55-980c-4a8b-b6e8-83ed408c3d21 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:11.707203 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a842c55-980c-4a8b-b6e8-83ed408c3d21 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:11.758868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1a842c55-980c-4a8b-b6e8-83ed408c3d21 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 06 20:35:11.759210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a842c55-980c-4a8b-b6e8-83ed408c3d21 admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:11.769706 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Sat Aug 6 20:35:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:35:11.779402 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d12d1-cdc2-46e0-adea-b5fc52f47e07 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:11.799457 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d12d1-cdc2-46e0-adea-b5fc52f47e07 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:11.808078 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd49ce6-548d-4346-a6ac-f18702859027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:11.809113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd49ce6-548d-4346-a6ac-f18702859027 admin admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:11.809418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd49ce6-548d-4346-a6ac-f18702859027 admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:11.809678 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd49ce6-548d-4346-a6ac-f18702859027 admin admin] PATH_INFO: `/v3/projects/42f40b6097a64b0993acc9ebaceea81e` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:11.811169 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd49ce6-548d-4346-a6ac-f18702859027 admin admin] RBAC: Authorizing `identity:get_project(project_id=42f40b6097a64b0993acc9ebaceea81e)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:11.862173 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fdd49ce6-548d-4346-a6ac-f18702859027 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 06 20:35:11.862486 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd49ce6-548d-4346-a6ac-f18702859027 admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:11.867514 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Sat Aug 6 20:35:11 2022] GET /identity/v3/projects/42f40b6097a64b0993acc9ebaceea81e => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:14.076734 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf246db-7a3b-451c-9add-c7fb4f0d2c07 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:14.077273 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf246db-7a3b-451c-9add-c7fb4f0d2c07 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:14.077273 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf246db-7a3b-451c-9add-c7fb4f0d2c07 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:14.084028 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:14.091493 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a241c-3719-40e6-b747-778f8353bb36 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:14.091942 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a241c-3719-40e6-b747-778f8353bb36 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:14.092033 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a241c-3719-40e6-b747-778f8353bb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:14.113025 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-725a241c-3719-40e6-b747-778f8353bb36 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:14.114552 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-725a241c-3719-40e6-b747-778f8353bb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:14.123635 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 06 20:35:14.146975 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf246db-7a3b-451c-9add-c7fb4f0d2c07 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:14.160877 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf246db-7a3b-451c-9add-c7fb4f0d2c07 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:14.166541 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64019042-2d1c-43d4-8872-ed5474481b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:14.167171 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64019042-2d1c-43d4-8872-ed5474481b5e admin admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:14.167446 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64019042-2d1c-43d4-8872-ed5474481b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:14.167706 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64019042-2d1c-43d4-8872-ed5474481b5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:14.175896 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64019042-2d1c-43d4-8872-ed5474481b5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:14.177663 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64019042-2d1c-43d4-8872-ed5474481b5e admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:14.186980 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Sat Aug 6 20:35:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:35:14.192557 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a241c-3719-40e6-b747-778f8353bb36 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:14.202013 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a241c-3719-40e6-b747-778f8353bb36 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:14.208078 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bbc4b-ac43-41cf-83ab-bf561e259c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:14.208705 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bbc4b-ac43-41cf-83ab-bf561e259c5e admin admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:14.208986 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bbc4b-ac43-41cf-83ab-bf561e259c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:14.209251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bbc4b-ac43-41cf-83ab-bf561e259c5e admin admin] PATH_INFO: `/v3/users/2d2bdc2d34c34554b4a922abe3128eee` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:14.211111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bbc4b-ac43-41cf-83ab-bf561e259c5e admin admin] RBAC: Authorizing `identity:get_user(user_id=2d2bdc2d34c34554b4a922abe3128eee)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:14.213159 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bbc4b-ac43-41cf-83ab-bf561e259c5e admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:14.214793 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Sat Aug 6 20:35:14 2022] GET /identity/v3/users/2d2bdc2d34c34554b4a922abe3128eee => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:16.518736 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a0de4-d8df-4deb-bef5-1d83ca16bea5 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:16.519292 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a0de4-d8df-4deb-bef5-1d83ca16bea5 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:16.519386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b74ac-0c53-446a-885d-7767a38fd6dd None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:16.519739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a0de4-d8df-4deb-bef5-1d83ca16bea5 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:16.519828 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b74ac-0c53-446a-885d-7767a38fd6dd None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:16.519828 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b74ac-0c53-446a-885d-7767a38fd6dd None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:16.520557 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:16.521243 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:16.528569 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5b30a-1b14-41ae-8a7c-e28318ae0530 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:16.528858 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5b30a-1b14-41ae-8a7c-e28318ae0530 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:16.529061 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31a8d2-e373-4214-a64e-935c8b83a558 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:16.529165 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5b30a-1b14-41ae-8a7c-e28318ae0530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:16.529343 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31a8d2-e373-4214-a64e-935c8b83a558 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:16.529614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31a8d2-e373-4214-a64e-935c8b83a558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:16.549654 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-3c31a8d2-e373-4214-a64e-935c8b83a558 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:16.550902 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-3c31a8d2-e373-4214-a64e-935c8b83a558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:16.570354 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG passlib.handlers.bcrypt [None req-24c5b30a-1b14-41ae-8a7c-e28318ae0530 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93752) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 06 20:35:16.570803 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG passlib.handlers.bcrypt [None req-24c5b30a-1b14-41ae-8a7c-e28318ae0530 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93752) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 06 20:35:16.615939 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-24c5b30a-1b14-41ae-8a7c-e28318ae0530 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:16.617573 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-24c5b30a-1b14-41ae-8a7c-e28318ae0530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:16.634375 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 7/12] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:35:16.657009 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31a8d2-e373-4214-a64e-935c8b83a558 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:16.681353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:16.719201 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 6/13] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:16.743061 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5b30a-1b14-41ae-8a7c-e28318ae0530 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:16.762536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31a8d2-e373-4214-a64e-935c8b83a558 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:16.797601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e373cd-c1f8-4369-b281-f6a170dc6f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:16.798211 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e373cd-c1f8-4369-b281-f6a170dc6f2d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:16.798480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e373cd-c1f8-4369-b281-f6a170dc6f2d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:16.798806 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e373cd-c1f8-4369-b281-f6a170dc6f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:16.843597 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5b30a-1b14-41ae-8a7c-e28318ae0530 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:16.846518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:16.866046 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e373cd-c1f8-4369-b281-f6a170dc6f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:16.867592 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e373cd-c1f8-4369-b281-f6a170dc6f2d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:16.881866 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ab422-22b3-4595-b214-d1a2c69b5c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:16.883030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ab422-22b3-4595-b214-d1a2c69b5c0f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:16.883312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ab422-22b3-4595-b214-d1a2c69b5c0f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:16.883582 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ab422-22b3-4595-b214-d1a2c69b5c0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:16.891855 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:16.896313 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ab422-22b3-4595-b214-d1a2c69b5c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-364ab422-22b3-4595-b214-d1a2c69b5c0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:16.905014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:16.905912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:16.906973 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:16.906973 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:16.906973 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:16.906973 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:16.906973 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:16.906973 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:16.906973 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:16.906973 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:16.906973 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:16.906973 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:16.906973 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:16.906973 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:35:16.906973 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:35:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:35:16.912212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ab422-22b3-4595-b214-d1a2c69b5c0f None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:16.967802 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 8/15] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:35:16.973942 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e373cd-c1f8-4369-b281-f6a170dc6f2d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:17.009667 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ab422-22b3-4595-b214-d1a2c69b5c0f None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:17.043967 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60957364-9f7e-4420-885d-989ccd437dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:17.043967 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60957364-9f7e-4420-885d-989ccd437dd7 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:17.044326 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60957364-9f7e-4420-885d-989ccd437dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:17.044506 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60957364-9f7e-4420-885d-989ccd437dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:17.045168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60957364-9f7e-4420-885d-989ccd437dd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:17.045465 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60957364-9f7e-4420-885d-989ccd437dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:17.046920 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60957364-9f7e-4420-885d-989ccd437dd7 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:17.058416 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 8/16] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:17.064144 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60957364-9f7e-4420-885d-989ccd437dd7 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:17.073186 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e373cd-c1f8-4369-b281-f6a170dc6f2d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:17.090152 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:17.096393 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:17.108083 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83418b04-a85a-412e-b5e8-2fe5008555bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:17.108719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83418b04-a85a-412e-b5e8-2fe5008555bd None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:17.108994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83418b04-a85a-412e-b5e8-2fe5008555bd None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:17.109259 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83418b04-a85a-412e-b5e8-2fe5008555bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:17.119154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83418b04-a85a-412e-b5e8-2fe5008555bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:17.120662 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83418b04-a85a-412e-b5e8-2fe5008555bd None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-83418b04-a85a-412e-b5e8-2fe5008555bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:35:17.137936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:17.138840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:35:17.139619 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:35:17.139619 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:35:17.139619 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:17.139619 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:17.145068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83418b04-a85a-412e-b5e8-2fe5008555bd None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:17.165533 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60957364-9f7e-4420-885d-989ccd437dd7 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:17.200774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc670ad-d944-4bff-80bd-d906cbc4b541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:17.201458 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc670ad-d944-4bff-80bd-d906cbc4b541 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:17.201729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc670ad-d944-4bff-80bd-d906cbc4b541 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:17.201995 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc670ad-d944-4bff-80bd-d906cbc4b541 None admin] PATH_INFO: `/v3/users/2d2bdc2d34c34554b4a922abe3128eee` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:17.203479 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc670ad-d944-4bff-80bd-d906cbc4b541 None admin] RBAC: Authorizing `identity:get_user(user_id=2d2bdc2d34c34554b4a922abe3128eee)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:17.204927 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc670ad-d944-4bff-80bd-d906cbc4b541 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:17.206480 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:17 2022] GET /identity/v3/users/2d2bdc2d34c34554b4a922abe3128eee => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:17.212275 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc670ad-d944-4bff-80bd-d906cbc4b541 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:17.244949 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83418b04-a85a-412e-b5e8-2fe5008555bd None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:17.277549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826864f-6a5f-4c85-87ab-94abee2f7eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:17.278083 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826864f-6a5f-4c85-87ab-94abee2f7eb7 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:17.278331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826864f-6a5f-4c85-87ab-94abee2f7eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:17.278591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826864f-6a5f-4c85-87ab-94abee2f7eb7 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:17.279237 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826864f-6a5f-4c85-87ab-94abee2f7eb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:17.279532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826864f-6a5f-4c85-87ab-94abee2f7eb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:17.280955 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826864f-6a5f-4c85-87ab-94abee2f7eb7 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:17.298250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:17.304146 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:17.311786 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc670ad-d944-4bff-80bd-d906cbc4b541 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:17.350222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ba381-c6d4-4bda-a7f1-362571893f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:17.351050 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ba381-c6d4-4bda-a7f1-362571893f09 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:17.351366 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ba381-c6d4-4bda-a7f1-362571893f09 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:17.351635 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ba381-c6d4-4bda-a7f1-362571893f09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:17.352912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ba381-c6d4-4bda-a7f1-362571893f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:17.354529 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ba381-c6d4-4bda-a7f1-362571893f09 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:17.356225 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:35:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:17.362723 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826864f-6a5f-4c85-87ab-94abee2f7eb7 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:17.405158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:17.477555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826864f-6a5f-4c85-87ab-94abee2f7eb7 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:17.514282 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0567a6-4088-47d4-9945-de2aa275dd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:17.514991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0567a6-4088-47d4-9945-de2aa275dd7f None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:17.515258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0567a6-4088-47d4-9945-de2aa275dd7f None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:17.515526 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0567a6-4088-47d4-9945-de2aa275dd7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:17.516228 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0567a6-4088-47d4-9945-de2aa275dd7f None admin] RBAC: Adding query filter params (role.id=e62e78acab6b46f6a866b4980700caae, scope.domain.id=default, user.id=2d2bdc2d34c34554b4a922abe3128eee) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:17.516529 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0567a6-4088-47d4-9945-de2aa275dd7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:17.518010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0567a6-4088-47d4-9945-de2aa275dd7f None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:17.525003 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 11/21] 10.222.0.36 () {56 vars in 1322 bytes} [Sat Aug 6 20:35:17 2022] GET /identity/v3/role_assignments?user.id=2d2bdc2d34c34554b4a922abe3128eee&scope.domain.id=default&role.id=e62e78acab6b46f6a866b4980700caae => generated 233 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:20.034439 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80148fa5-74f7-42ac-b3d2-82fb651fda08 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:20.035100 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80148fa5-74f7-42ac-b3d2-82fb651fda08 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:20.035100 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80148fa5-74f7-42ac-b3d2-82fb651fda08 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:20.036338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 11/22] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:20.044411 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e25198-a947-46dd-a289-4958ba6c6fcb None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:20.045252 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e25198-a947-46dd-a289-4958ba6c6fcb None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:20.045732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e25198-a947-46dd-a289-4958ba6c6fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:20.071974 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-d9e25198-a947-46dd-a289-4958ba6c6fcb None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:20.073500 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-d9e25198-a947-46dd-a289-4958ba6c6fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:20.089138 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f649ccd-3f22-4f28-9367-148c09657355 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:20.089453 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f649ccd-3f22-4f28-9367-148c09657355 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:20.089715 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f649ccd-3f22-4f28-9367-148c09657355 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:20.091139 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 12/23] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:35:20.099890 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481c95e-8134-4f7c-88a6-0c8d71b0410d None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:20.100172 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481c95e-8134-4f7c-88a6-0c8d71b0410d None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:20.100443 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481c95e-8134-4f7c-88a6-0c8d71b0410d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:20.132630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-5481c95e-8134-4f7c-88a6-0c8d71b0410d None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:20.133848 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-5481c95e-8134-4f7c-88a6-0c8d71b0410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:20.242361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 12/24] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:20.264782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 13/25] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 06 20:35:20.296221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e25198-a947-46dd-a289-4958ba6c6fcb None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:20.306260 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481c95e-8134-4f7c-88a6-0c8d71b0410d None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:20.357711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:20.486957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:20.507375 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481c95e-8134-4f7c-88a6-0c8d71b0410d None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:20.517796 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e25198-a947-46dd-a289-4958ba6c6fcb None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:20.577467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedfb08-606d-408e-8fc5-94f2257849c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:20.578013 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedfb08-606d-408e-8fc5-94f2257849c2 None admin] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:20.578290 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedfb08-606d-408e-8fc5-94f2257849c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:20.578558 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedfb08-606d-408e-8fc5-94f2257849c2 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:20.579244 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedfb08-606d-408e-8fc5-94f2257849c2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:20.580653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedfb08-606d-408e-8fc5-94f2257849c2 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:20.595771 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ff19c-72bf-4def-9946-6d7a18bf80bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:20.596512 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ff19c-72bf-4def-9946-6d7a18bf80bd None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:20.596787 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ff19c-72bf-4def-9946-6d7a18bf80bd None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:20.597055 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ff19c-72bf-4def-9946-6d7a18bf80bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:20.656206 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ff19c-72bf-4def-9946-6d7a18bf80bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:20.657725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ff19c-72bf-4def-9946-6d7a18bf80bd None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-9b7ff19c-72bf-4def-9946-6d7a18bf80bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:35:20.700105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:20.701008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:35:20.701832 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:35:20.701832 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:35:20.701832 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:35:20.704661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 14/26] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:20.710786 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ff19c-72bf-4def-9946-6d7a18bf80bd None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:20.816867 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 13/27] 10.222.0.36 () {60 vars in 1131 bytes} [Sat Aug 6 20:35:20 2022] POST /identity/v3/roles => generated 219 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:35:20.816867 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc8ab8-65e5-4ceb-9fb5-84753ae59672 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:20.816867 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc8ab8-65e5-4ceb-9fb5-84753ae59672 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:20.816867 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc8ab8-65e5-4ceb-9fb5-84753ae59672 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:20.816867 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 14/28] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:20.823820 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9031dbd-29f8-4e9f-8f85-bbd71a795fc0 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:20.824149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9031dbd-29f8-4e9f-8f85-bbd71a795fc0 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:20.824373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9031dbd-29f8-4e9f-8f85-bbd71a795fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:20.847663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-d9031dbd-29f8-4e9f-8f85-bbd71a795fc0 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:20.850210 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-d9031dbd-29f8-4e9f-8f85-bbd71a795fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:20.910741 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ff19c-72bf-4def-9946-6d7a18bf80bd None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:20.982681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a53a9-764e-4c59-80b9-536140d95532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:20.983323 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a53a9-764e-4c59-80b9-536140d95532 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:20.983599 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a53a9-764e-4c59-80b9-536140d95532 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:20.983866 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a53a9-764e-4c59-80b9-536140d95532 None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:20.984523 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a53a9-764e-4c59-80b9-536140d95532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:20.984824 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a53a9-764e-4c59-80b9-536140d95532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:20.986522 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a53a9-764e-4c59-80b9-536140d95532 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:21.020208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 15/29] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:21.027831 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a53a9-764e-4c59-80b9-536140d95532 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:21.034923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:21.105707 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 15/30] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:21.107176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fe2f5-bb0a-45bb-a021-67e06f73ec89 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:21.107469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fe2f5-bb0a-45bb-a021-67e06f73ec89 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:21.107745 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fe2f5-bb0a-45bb-a021-67e06f73ec89 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:21.109609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 16/31] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:21.115391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f153eb9-a8f1-4d47-a79e-369d382067e9 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:21.115672 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f153eb9-a8f1-4d47-a79e-369d382067e9 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:21.116007 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f153eb9-a8f1-4d47-a79e-369d382067e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:21.152244 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-5f153eb9-a8f1-4d47-a79e-369d382067e9 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:21.153447 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-5f153eb9-a8f1-4d47-a79e-369d382067e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:21.174521 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a53a9-764e-4c59-80b9-536140d95532 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:21.176382 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:21.221434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5f680-b489-49ad-bb4a-5f028753a3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:21.222055 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5f680-b489-49ad-bb4a-5f028753a3fe None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:21.222332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5f680-b489-49ad-bb4a-5f028753a3fe None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:21.222615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5f680-b489-49ad-bb4a-5f028753a3fe None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:21.223825 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5f680-b489-49ad-bb4a-5f028753a3fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:21.225523 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5f680-b489-49ad-bb4a-5f028753a3fe None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:21.240539 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 17/32] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:21.241848 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f153eb9-a8f1-4d47-a79e-369d382067e9 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:21.362078 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f153eb9-a8f1-4d47-a79e-369d382067e9 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:21.398226 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2408c-c1cf-419e-9f32-d3a99ed22a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:21.398452 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 16/33] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Aug 6 20:35:21 2022] POST /identity/v3/projects => generated 301 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:35:21.400098 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50b23f-fd60-4a2f-a118-05b2cbcb5572 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:21.400427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50b23f-fd60-4a2f-a118-05b2cbcb5572 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:21.401460 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50b23f-fd60-4a2f-a118-05b2cbcb5572 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:21.403203 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 17/34] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:21.403780 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50b23f-fd60-4a2f-a118-05b2cbcb5572 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:21.410717 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2408c-c1cf-419e-9f32-d3a99ed22a3d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:21.410717 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2408c-c1cf-419e-9f32-d3a99ed22a3d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:21.410717 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2408c-c1cf-419e-9f32-d3a99ed22a3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:21.432157 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2408c-c1cf-419e-9f32-d3a99ed22a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-77f2408c-c1cf-419e-9f32-d3a99ed22a3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:21.439132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:21.440133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:21.440856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:21.440856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:21.440856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:21.440856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:21.440856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:21.440856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:21.440856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:21.440856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:21.440856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:21.440856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:21.440856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:21.440856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:21.440856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 18/35] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:35:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:21.441958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d5c7-862f-4e04-8886-0dad29bdf604 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:21.442615 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d5c7-862f-4e04-8886-0dad29bdf604 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:21.442615 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d5c7-862f-4e04-8886-0dad29bdf604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:21.465566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-0086d5c7-862f-4e04-8886-0dad29bdf604 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:21.467939 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-0086d5c7-862f-4e04-8886-0dad29bdf604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:21.471154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:21.496453 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:21.551501 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50b23f-fd60-4a2f-a118-05b2cbcb5572 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:21.575192 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 19/36] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:21.576469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086d5c7-862f-4e04-8886-0dad29bdf604 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:21.588818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f8f8b-3b6f-4ec2-a495-9a9927490583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:21.589544 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f8f8b-3b6f-4ec2-a495-9a9927490583 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:21.589884 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f8f8b-3b6f-4ec2-a495-9a9927490583 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:21.590245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f8f8b-3b6f-4ec2-a495-9a9927490583 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:21.591014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f8f8b-3b6f-4ec2-a495-9a9927490583 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:21.592628 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f8f8b-3b6f-4ec2-a495-9a9927490583 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:21.613499 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1131 bytes} [Sat Aug 6 20:35:21 2022] POST /identity/v3/roles => generated 225 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:35:21.614523 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff330bd-02ba-446a-89f4-87c739c21adf None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:21.615102 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff330bd-02ba-446a-89f4-87c739c21adf None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:21.615102 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff330bd-02ba-446a-89f4-87c739c21adf None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:21.616451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 19/38] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:21.616979 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff330bd-02ba-446a-89f4-87c739c21adf None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:21.712242 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086d5c7-862f-4e04-8886-0dad29bdf604 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:21.752805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff330bd-02ba-446a-89f4-87c739c21adf None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:21.756517 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb2d22-fb37-4b88-939a-5c5db1c79529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:21.757173 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb2d22-fb37-4b88-939a-5c5db1c79529 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:21.757462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb2d22-fb37-4b88-939a-5c5db1c79529 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:21.757734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb2d22-fb37-4b88-939a-5c5db1c79529 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:21.758427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb2d22-fb37-4b88-939a-5c5db1c79529 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:21.758769 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb2d22-fb37-4b88-939a-5c5db1c79529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:21.760593 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb2d22-fb37-4b88-939a-5c5db1c79529 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:21.771979 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:21.772488 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:21.778160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 20/39] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:21.782630 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7ddcf-ea21-48c3-b1ae-7d87109d7b8a None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:21.782630 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7ddcf-ea21-48c3-b1ae-7d87109d7b8a None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:21.782630 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7ddcf-ea21-48c3-b1ae-7d87109d7b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:21.799660 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6407bf9-4b97-47e0-a35c-15388e907364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:21.800300 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6407bf9-4b97-47e0-a35c-15388e907364 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:21.800576 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6407bf9-4b97-47e0-a35c-15388e907364 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:21.800844 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6407bf9-4b97-47e0-a35c-15388e907364 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:21.801530 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6407bf9-4b97-47e0-a35c-15388e907364 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:21.802926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6407bf9-4b97-47e0-a35c-15388e907364 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:21.805615 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-f7d7ddcf-ea21-48c3-b1ae-7d87109d7b8a None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:21.807071 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-f7d7ddcf-ea21-48c3-b1ae-7d87109d7b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:21.822288 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1131 bytes} [Sat Aug 6 20:35:21 2022] POST /identity/v3/roles => generated 223 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:35:21.823333 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6407bf9-4b97-47e0-a35c-15388e907364 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:21.895652 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 21/41] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:21.920284 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7ddcf-ea21-48c3-b1ae-7d87109d7b8a None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:21.965223 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6407bf9-4b97-47e0-a35c-15388e907364 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:22.007727 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed258202-ae49-4493-a679-cdd6f6055ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:22.008377 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed258202-ae49-4493-a679-cdd6f6055ff1 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:22.008662 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed258202-ae49-4493-a679-cdd6f6055ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:22.008936 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed258202-ae49-4493-a679-cdd6f6055ff1 None admin] PATH_INFO: `/v3/users/2d2bdc2d34c34554b4a922abe3128eee` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:22.010336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed258202-ae49-4493-a679-cdd6f6055ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=2d2bdc2d34c34554b4a922abe3128eee)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:22.011845 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed258202-ae49-4493-a679-cdd6f6055ff1 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:22.013454 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 21/42] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:21 2022] GET /identity/v3/users/2d2bdc2d34c34554b4a922abe3128eee => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:22.019453 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed258202-ae49-4493-a679-cdd6f6055ff1 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:22.030036 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7ddcf-ea21-48c3-b1ae-7d87109d7b8a None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:22.065714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:22.071212 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883e564-4cf5-4f4c-8269-5d71ac72fbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:22.071980 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883e564-4cf5-4f4c-8269-5d71ac72fbe1 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:22.072179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883e564-4cf5-4f4c-8269-5d71ac72fbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:22.072442 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883e564-4cf5-4f4c-8269-5d71ac72fbe1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:22.073558 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883e564-4cf5-4f4c-8269-5d71ac72fbe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:22.075080 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883e564-4cf5-4f4c-8269-5d71ac72fbe1 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:22.075204 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:22.077086 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 22/43] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:35:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:22.082784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883e564-4cf5-4f4c-8269-5d71ac72fbe1 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:22.132438 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed258202-ae49-4493-a679-cdd6f6055ff1 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:22.165367 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99c8ce-764c-4747-9f94-e67814f014bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:22.165978 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99c8ce-764c-4747-9f94-e67814f014bc None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:22.166253 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99c8ce-764c-4747-9f94-e67814f014bc None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:22.166530 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99c8ce-764c-4747-9f94-e67814f014bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:22.167771 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99c8ce-764c-4747-9f94-e67814f014bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:22.169240 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99c8ce-764c-4747-9f94-e67814f014bc None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:22.171036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 22/44] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:35:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:22.176610 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99c8ce-764c-4747-9f94-e67814f014bc None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:22.183188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883e564-4cf5-4f4c-8269-5d71ac72fbe1 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:22.216378 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd49682-d0b2-477d-bfe5-83a3b90f3426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:22.216991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd49682-d0b2-477d-bfe5-83a3b90f3426 None admin] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:22.217269 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd49682-d0b2-477d-bfe5-83a3b90f3426 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:22.217541 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd49682-d0b2-477d-bfe5-83a3b90f3426 None admin] PATH_INFO: `/v3/projects` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:22.218182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd49682-d0b2-477d-bfe5-83a3b90f3426 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:22.220026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd49682-d0b2-477d-bfe5-83a3b90f3426 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:22.250247 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Aug 6 20:35:22 2022] POST /identity/v3/projects => generated 312 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:35:22.280202 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99c8ce-764c-4747-9f94-e67814f014bc None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:22.295871 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:22.318441 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684c53d-e2d7-4e13-ae05-0519422e2775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:22.319168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684c53d-e2d7-4e13-ae05-0519422e2775 None admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:22.319449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684c53d-e2d7-4e13-ae05-0519422e2775 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:22.319733 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684c53d-e2d7-4e13-ae05-0519422e2775 None admin] PATH_INFO: `/v3/domains/default/users/2d2bdc2d34c34554b4a922abe3128eee/roles/e62e78acab6b46f6a866b4980700caae` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:22.321746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684c53d-e2d7-4e13-ae05-0519422e2775 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2d2bdc2d34c34554b4a922abe3128eee, role_id=e62e78acab6b46f6a866b4980700caae)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:22.323338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684c53d-e2d7-4e13-ae05-0519422e2775 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:22.340913 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 23/46] 10.222.0.36 () {58 vars in 1361 bytes} [Sat Aug 6 20:35:22 2022] PUT /identity/v3/domains/default/users/2d2bdc2d34c34554b4a922abe3128eee/roles/e62e78acab6b46f6a866b4980700caae => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:35:24.502417 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee04834-e785-4804-8d7a-03ed58c38fce None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:24.502971 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee04834-e785-4804-8d7a-03ed58c38fce None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:24.502971 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee04834-e785-4804-8d7a-03ed58c38fce None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:24.504324 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 24/47] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:24.509766 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee438e5-2ad4-424f-9b95-030644e95924 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:24.510335 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee438e5-2ad4-424f-9b95-030644e95924 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:24.510335 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee438e5-2ad4-424f-9b95-030644e95924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:24.529699 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-1ee438e5-2ad4-424f-9b95-030644e95924 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:24.531246 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-1ee438e5-2ad4-424f-9b95-030644e95924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:24.550629 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d769e5-8aec-4a8e-af1e-58edcc809b27 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:24.551021 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d769e5-8aec-4a8e-af1e-58edcc809b27 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:24.551361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d769e5-8aec-4a8e-af1e-58edcc809b27 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:24.552745 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 25/48] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:24.558020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884102b-3213-44be-b6d7-ee03c51424e8 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:24.558303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884102b-3213-44be-b6d7-ee03c51424e8 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:24.558543 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884102b-3213-44be-b6d7-ee03c51424e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:24.576658 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-a884102b-3213-44be-b6d7-ee03c51424e8 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:24.577852 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-a884102b-3213-44be-b6d7-ee03c51424e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:24.600619 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 24/49] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:24.624537 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee438e5-2ad4-424f-9b95-030644e95924 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:24.625100 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:24.647335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 26/50] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:35:24.671441 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884102b-3213-44be-b6d7-ee03c51424e8 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:24.724236 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee438e5-2ad4-424f-9b95-030644e95924 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:24.725896 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:24.760569 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f30fb-e3cd-43c0-a39e-045b62ec2883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:24.761201 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f30fb-e3cd-43c0-a39e-045b62ec2883 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:24.761856 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f30fb-e3cd-43c0-a39e-045b62ec2883 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:24.762118 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f30fb-e3cd-43c0-a39e-045b62ec2883 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:24.763252 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f30fb-e3cd-43c0-a39e-045b62ec2883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:24.764706 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f30fb-e3cd-43c0-a39e-045b62ec2883 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:24.766261 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 25/51] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:35:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:24.771952 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f30fb-e3cd-43c0-a39e-045b62ec2883 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:24.782292 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884102b-3213-44be-b6d7-ee03c51424e8 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:24.820164 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee610f-8c99-46ae-a49b-d336cb37536d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:24.820802 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee610f-8c99-46ae-a49b-d336cb37536d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:24.821133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee610f-8c99-46ae-a49b-d336cb37536d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:24.821412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee610f-8c99-46ae-a49b-d336cb37536d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:24.831836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee610f-8c99-46ae-a49b-d336cb37536d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-b4ee610f-8c99-46ae-a49b-d336cb37536d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:24.836596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:24.837400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:24.838566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:24.838566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:24.838566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:24.838566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:24.838566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:24.838566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:24.838566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:24.838566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:24.838566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:24.838566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:24.838566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:24.838566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:24.838566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 27/52] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:35:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:35:24.843980 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee610f-8c99-46ae-a49b-d336cb37536d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:24.879740 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f30fb-e3cd-43c0-a39e-045b62ec2883 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:24.887441 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:24.913055 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e08404-4d58-45e2-a7af-c76d86059f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:24.913665 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e08404-4d58-45e2-a7af-c76d86059f0d None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:24.913947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e08404-4d58-45e2-a7af-c76d86059f0d None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:24.914220 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e08404-4d58-45e2-a7af-c76d86059f0d None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:24.914919 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e08404-4d58-45e2-a7af-c76d86059f0d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:24.916570 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e08404-4d58-45e2-a7af-c76d86059f0d None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:24.945431 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 26/53] 10.222.0.36 () {60 vars in 1140 bytes} [Sat Aug 6 20:35:24 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:35:24.947856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee610f-8c99-46ae-a49b-d336cb37536d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:24.987540 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13173c-ea5f-4a47-8f8e-1a99506468a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:24.988170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13173c-ea5f-4a47-8f8e-1a99506468a6 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:24.988450 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13173c-ea5f-4a47-8f8e-1a99506468a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:24.988721 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13173c-ea5f-4a47-8f8e-1a99506468a6 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:24.989403 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13173c-ea5f-4a47-8f8e-1a99506468a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:24.989702 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13173c-ea5f-4a47-8f8e-1a99506468a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:24.991163 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13173c-ea5f-4a47-8f8e-1a99506468a6 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:25.002019 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 28/54] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:25.007872 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e08404-4d58-45e2-a7af-c76d86059f0d None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:25.036422 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:25.124575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e08404-4d58-45e2-a7af-c76d86059f0d None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:25.165337 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c96da-2f0b-4ca7-a940-e58c12b577f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:25.166876 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c96da-2f0b-4ca7-a940-e58c12b577f2 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:25.167160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c96da-2f0b-4ca7-a940-e58c12b577f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:25.167437 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c96da-2f0b-4ca7-a940-e58c12b577f2 None admin] PATH_INFO: `/v3/users/2d2bdc2d34c34554b4a922abe3128eee` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:25.168604 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c96da-2f0b-4ca7-a940-e58c12b577f2 None admin] RBAC: Authorizing `identity:get_user(user_id=2d2bdc2d34c34554b4a922abe3128eee)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:25.170046 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c96da-2f0b-4ca7-a940-e58c12b577f2 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:25.171664 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:25 2022] GET /identity/v3/users/2d2bdc2d34c34554b4a922abe3128eee => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:25.177313 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13173c-ea5f-4a47-8f8e-1a99506468a6 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:25.285820 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13173c-ea5f-4a47-8f8e-1a99506468a6 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:25.287311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:25.324620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50040fa5-9a54-4181-8840-1c9a717a71af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:25.325293 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50040fa5-9a54-4181-8840-1c9a717a71af None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:25.325593 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50040fa5-9a54-4181-8840-1c9a717a71af None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:25.325953 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50040fa5-9a54-4181-8840-1c9a717a71af None admin] PATH_INFO: `/v3/domains/default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:25.327207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50040fa5-9a54-4181-8840-1c9a717a71af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:25.328720 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50040fa5-9a54-4181-8840-1c9a717a71af None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:25.330450 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 29/56] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:35:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:25.336753 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c96da-2f0b-4ca7-a940-e58c12b577f2 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:25.447311 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:25.461455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c96da-2f0b-4ca7-a940-e58c12b577f2 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:25.500119 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b9148-8a11-4984-b95b-1faae1bea240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:25.500739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b9148-8a11-4984-b95b-1faae1bea240 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:25.501018 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b9148-8a11-4984-b95b-1faae1bea240 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:25.501272 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b9148-8a11-4984-b95b-1faae1bea240 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:25.501995 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b9148-8a11-4984-b95b-1faae1bea240 None admin] RBAC: Adding query filter params (role.id=e62e78acab6b46f6a866b4980700caae, scope.domain.id=default, user.id=2d2bdc2d34c34554b4a922abe3128eee) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:25.502299 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b9148-8a11-4984-b95b-1faae1bea240 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:25.503779 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b9148-8a11-4984-b95b-1faae1bea240 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:25.511985 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1322 bytes} [Sat Aug 6 20:35:25 2022] GET /identity/v3/role_assignments?user.id=2d2bdc2d34c34554b4a922abe3128eee&scope.domain.id=default&role.id=e62e78acab6b46f6a866b4980700caae => generated 530 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:27.204784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c095041-1b9a-4f84-92e2-0cdf2ae505a8 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:27.205614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c095041-1b9a-4f84-92e2-0cdf2ae505a8 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:27.205614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c095041-1b9a-4f84-92e2-0cdf2ae505a8 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:27.207909 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 30/58] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:27.213592 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b21df-1049-4f63-844b-859fa808a1a8 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:27.214002 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b21df-1049-4f63-844b-859fa808a1a8 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:27.214123 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b21df-1049-4f63-844b-859fa808a1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:27.234450 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-406b21df-1049-4f63-844b-859fa808a1a8 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:27.235680 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-406b21df-1049-4f63-844b-859fa808a1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:27.308023 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 29/59] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:27.333988 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c095041-1b9a-4f84-92e2-0cdf2ae505a8 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:27.459347 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c095041-1b9a-4f84-92e2-0cdf2ae505a8 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:27.498920 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ce0b9-b20c-499e-bb6c-03c0a37716b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:27.499551 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce0b9-b20c-499e-bb6c-03c0a37716b3 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:27.499824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce0b9-b20c-499e-bb6c-03c0a37716b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:27.500088 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce0b9-b20c-499e-bb6c-03c0a37716b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:27.501206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ce0b9-b20c-499e-bb6c-03c0a37716b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:27.502703 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ce0b9-b20c-499e-bb6c-03c0a37716b3 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:27.504291 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 31/60] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:35:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:27.510517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b21df-1049-4f63-844b-859fa808a1a8 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:27.597621 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:27.614760 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b21df-1049-4f63-844b-859fa808a1a8 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:27.654449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c7f01-d8cd-462c-90ea-1901a5347fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:27.655100 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c7f01-d8cd-462c-90ea-1901a5347fe6 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:27.655386 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c7f01-d8cd-462c-90ea-1901a5347fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:27.655661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c7f01-d8cd-462c-90ea-1901a5347fe6 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:27.656306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c7f01-d8cd-462c-90ea-1901a5347fe6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:27.657774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c7f01-d8cd-462c-90ea-1901a5347fe6 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:27.686932 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 30/61] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Aug 6 20:35:27 2022] POST /identity/v3/users => generated 275 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:35:30.978640 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bde00d-7995-4684-9a58-48761d20518e None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:30.979660 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bde00d-7995-4684-9a58-48761d20518e None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:30.980133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bde00d-7995-4684-9a58-48761d20518e None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:30.981676 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 32/62] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:30.987209 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17072a0d-1e38-40be-8032-48c89954cf3e None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:30.988128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17072a0d-1e38-40be-8032-48c89954cf3e None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:30.988597 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17072a0d-1e38-40be-8032-48c89954cf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:31.011044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-17072a0d-1e38-40be-8032-48c89954cf3e None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:31.012235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-17072a0d-1e38-40be-8032-48c89954cf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:31.090723 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 31/63] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:31.130845 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bde00d-7995-4684-9a58-48761d20518e None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:31.176826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531302c0-2211-4ea2-ac20-6a5b240a6265 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:31.177253 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531302c0-2211-4ea2-ac20-6a5b240a6265 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:31.177617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531302c0-2211-4ea2-ac20-6a5b240a6265 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:31.180230 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 32/64] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:31.188031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bfaf3-4a23-4936-8915-03d19fcf5cab None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:31.191149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bfaf3-4a23-4936-8915-03d19fcf5cab None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:31.191569 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bfaf3-4a23-4936-8915-03d19fcf5cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:31.208670 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:31.227802 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-1c2bfaf3-4a23-4936-8915-03d19fcf5cab None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:31.229487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-1c2bfaf3-4a23-4936-8915-03d19fcf5cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:31.280267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bde00d-7995-4684-9a58-48761d20518e None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:31.323512 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:31.328387 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 33/65] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:31.330040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31454905-f5b4-44bf-ac49-7322d6f6a23c None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:31.330530 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31454905-f5b4-44bf-ac49-7322d6f6a23c None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:31.331146 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31454905-f5b4-44bf-ac49-7322d6f6a23c None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:31.336480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee51f9f-5c52-4a69-870a-85db8d6d87d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:31.336480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee51f9f-5c52-4a69-870a-85db8d6d87d7 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:31.336480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee51f9f-5c52-4a69-870a-85db8d6d87d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:31.336480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee51f9f-5c52-4a69-870a-85db8d6d87d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:31.337527 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 34/66] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:31.339437 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e479f1-b752-4c15-b68d-ffb7d4780e25 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:31.339929 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e479f1-b752-4c15-b68d-ffb7d4780e25 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:31.340401 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e479f1-b752-4c15-b68d-ffb7d4780e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:31.358405 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee51f9f-5c52-4a69-870a-85db8d6d87d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:31.363535 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-a9e479f1-b752-4c15-b68d-ffb7d4780e25 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-9ee51f9f-5c52-4a69-870a-85db8d6d87d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:31.364137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:31.364943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:31.365663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:31.365663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:31.365663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:31.365663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:31.365663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:31.365663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:31.365663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:31.365663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:31.365663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:31.365663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:31.365663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:31.365663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:31.366219 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-a9e479f1-b752-4c15-b68d-ffb7d4780e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:31.367995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 33/67] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:31.368859 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee51f9f-5c52-4a69-870a-85db8d6d87d7 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:31.454732 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 35/68] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:31.456246 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e479f1-b752-4c15-b68d-ffb7d4780e25 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:31.499083 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:31.503885 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee51f9f-5c52-4a69-870a-85db8d6d87d7 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:31.552438 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2b3f9-595a-4561-974e-498bd539743a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:31.553433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2b3f9-595a-4561-974e-498bd539743a None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:31.553976 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2b3f9-595a-4561-974e-498bd539743a None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:31.554438 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2b3f9-595a-4561-974e-498bd539743a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:31.566112 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2b3f9-595a-4561-974e-498bd539743a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-6ec2b3f9-595a-4561-974e-498bd539743a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:31.571711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:31.573155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:31.573915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:31.573915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:31.573915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:31.573915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:31.573915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:31.573915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:31.573915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:31.573915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:31.573915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:31.573915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:31.573915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:31.573915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:31.576194 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:35:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:31.577179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2b3f9-595a-4561-974e-498bd539743a None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:31.609842 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e479f1-b752-4c15-b68d-ffb7d4780e25 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:31.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:31.665778 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041db66b-5166-4ed4-a529-85d43621ee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:31.666543 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041db66b-5166-4ed4-a529-85d43621ee68 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:31.667243 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041db66b-5166-4ed4-a529-85d43621ee68 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:31.667633 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041db66b-5166-4ed4-a529-85d43621ee68 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:31.668303 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041db66b-5166-4ed4-a529-85d43621ee68 None admin] RBAC: Adding query filter params (name=member) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:31.668616 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041db66b-5166-4ed4-a529-85d43621ee68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:31.670764 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041db66b-5166-4ed4-a529-85d43621ee68 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:31.682081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 36/70] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:35:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:31.682985 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041db66b-5166-4ed4-a529-85d43621ee68 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:31.714235 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2b3f9-595a-4561-974e-498bd539743a None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:31.756232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cdbab-2286-4e35-a22c-ad95d9f06462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:31.757340 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cdbab-2286-4e35-a22c-ad95d9f06462 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:31.757811 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cdbab-2286-4e35-a22c-ad95d9f06462 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:31.758277 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cdbab-2286-4e35-a22c-ad95d9f06462 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:31.770412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cdbab-2286-4e35-a22c-ad95d9f06462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-4e6cdbab-2286-4e35-a22c-ad95d9f06462 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:31.779549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:31.780433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:31.781177 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:31.781177 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:31.781177 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:31.781177 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:31.781177 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:31.781177 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:31.781177 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:31.781177 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:31.781177 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:31.781177 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:31.781177 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:35:31.781177 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:31.781177 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:35:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:31.781788 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cdbab-2286-4e35-a22c-ad95d9f06462 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:31.802460 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:31.816481 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041db66b-5166-4ed4-a529-85d43621ee68 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:31.863252 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f2d62-fcea-4eea-96d2-776eb3a0b4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:31.863863 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f2d62-fcea-4eea-96d2-776eb3a0b4b0 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:31.864154 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f2d62-fcea-4eea-96d2-776eb3a0b4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:31.864422 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f2d62-fcea-4eea-96d2-776eb3a0b4b0 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:31.865075 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f2d62-fcea-4eea-96d2-776eb3a0b4b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:31.865380 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f2d62-fcea-4eea-96d2-776eb3a0b4b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:31.866914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f2d62-fcea-4eea-96d2-776eb3a0b4b0 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:31.875616 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 37/72] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:31.876988 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5aa51-e645-4811-8706-de38bbbd9b50 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:31.877272 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5aa51-e645-4811-8706-de38bbbd9b50 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:31.877542 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5aa51-e645-4811-8706-de38bbbd9b50 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:31.878864 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 38/73] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:31.879737 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5aa51-e645-4811-8706-de38bbbd9b50 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:31.905882 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cdbab-2286-4e35-a22c-ad95d9f06462 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:31.935156 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:31.939457 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6984ac9-c2f2-4ca1-ae33-2d4135092fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:31.940130 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6984ac9-c2f2-4ca1-ae33-2d4135092fa9 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:31.940404 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6984ac9-c2f2-4ca1-ae33-2d4135092fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:31.940670 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6984ac9-c2f2-4ca1-ae33-2d4135092fa9 None admin] PATH_INFO: `/v3/users/f074eceaddb146fab56e8b5769451851` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:31.953883 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6984ac9-c2f2-4ca1-ae33-2d4135092fa9 None admin] RBAC: Authorizing `identity:get_user(user_id=f074eceaddb146fab56e8b5769451851)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:31.955377 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6984ac9-c2f2-4ca1-ae33-2d4135092fa9 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:31.956970 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 36/74] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:31 2022] GET /identity/v3/users/f074eceaddb146fab56e8b5769451851 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:31.957731 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6984ac9-c2f2-4ca1-ae33-2d4135092fa9 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:31.982060 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5aa51-e645-4811-8706-de38bbbd9b50 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:32.015336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904986f-26f9-4def-b1d2-481fda0ec396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:32.015942 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904986f-26f9-4def-b1d2-481fda0ec396 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:32.016121 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904986f-26f9-4def-b1d2-481fda0ec396 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:32.016406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904986f-26f9-4def-b1d2-481fda0ec396 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:32.017061 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904986f-26f9-4def-b1d2-481fda0ec396 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:32.017362 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904986f-26f9-4def-b1d2-481fda0ec396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:32.018777 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904986f-26f9-4def-b1d2-481fda0ec396 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:32.027607 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 39/75] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:35:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:32.028598 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eee12b-a228-49f4-9c4d-39413ce6036c None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:32.028863 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eee12b-a228-49f4-9c4d-39413ce6036c None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:32.029135 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eee12b-a228-49f4-9c4d-39413ce6036c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:32.035629 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:32.046977 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-17eee12b-a228-49f4-9c4d-39413ce6036c None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:32.048165 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-17eee12b-a228-49f4-9c4d-39413ce6036c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:32.060664 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6984ac9-c2f2-4ca1-ae33-2d4135092fa9 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:32.095172 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7936ac6-e74d-4a04-818f-f7009e0f17d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:32.095857 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7936ac6-e74d-4a04-818f-f7009e0f17d2 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:32.096132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7936ac6-e74d-4a04-818f-f7009e0f17d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:32.096396 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7936ac6-e74d-4a04-818f-f7009e0f17d2 None admin] PATH_INFO: `/v3/users/2d2bdc2d34c34554b4a922abe3128eee` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:32.097530 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7936ac6-e74d-4a04-818f-f7009e0f17d2 None admin] RBAC: Authorizing `identity:get_user(user_id=2d2bdc2d34c34554b4a922abe3128eee)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:32.099010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7936ac6-e74d-4a04-818f-f7009e0f17d2 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:32.100568 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 37/76] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:31 2022] GET /identity/v3/users/2d2bdc2d34c34554b4a922abe3128eee => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:32.101770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecffdb9-4238-4bfb-a49b-94d9f297d6cf None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:32.102133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecffdb9-4238-4bfb-a49b-94d9f297d6cf None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:32.102277 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecffdb9-4238-4bfb-a49b-94d9f297d6cf None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:32.103784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 38/77] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:32.106754 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecffdb9-4238-4bfb-a49b-94d9f297d6cf None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:32.125704 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 40/78] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:32.126650 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eee12b-a228-49f4-9c4d-39413ce6036c None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:32.173414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:32.222890 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecffdb9-4238-4bfb-a49b-94d9f297d6cf None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:32.226045 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eee12b-a228-49f4-9c4d-39413ce6036c None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:32.256944 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2931e34-8649-4a29-a6ec-24332610ebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:32.257555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2931e34-8649-4a29-a6ec-24332610ebd2 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:32.257834 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2931e34-8649-4a29-a6ec-24332610ebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:32.258106 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2931e34-8649-4a29-a6ec-24332610ebd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:32.259117 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe438017-2683-466e-9e43-853b2873ddf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:32.259922 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe438017-2683-466e-9e43-853b2873ddf6 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:32.260194 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe438017-2683-466e-9e43-853b2873ddf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:32.260459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe438017-2683-466e-9e43-853b2873ddf6 None admin] PATH_INFO: `/v3/users/f074eceaddb146fab56e8b5769451851` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:32.261627 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe438017-2683-466e-9e43-853b2873ddf6 None admin] RBAC: Authorizing `identity:get_user(user_id=f074eceaddb146fab56e8b5769451851)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:32.263103 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe438017-2683-466e-9e43-853b2873ddf6 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:32.264831 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 41/79] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:32 2022] GET /identity/v3/users/f074eceaddb146fab56e8b5769451851 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:32.265546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe438017-2683-466e-9e43-853b2873ddf6 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:32.276469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:32.328259 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2931e34-8649-4a29-a6ec-24332610ebd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:32.329779 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2931e34-8649-4a29-a6ec-24332610ebd2 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:32.367117 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe438017-2683-466e-9e43-853b2873ddf6 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:32.380620 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:32.401293 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af316650-ef82-459a-828c-9dcf2264e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:32.401903 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af316650-ef82-459a-828c-9dcf2264e6ae None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:32.402183 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af316650-ef82-459a-828c-9dcf2264e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:32.402450 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af316650-ef82-459a-828c-9dcf2264e6ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:32.429247 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 39/80] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:35:32.430776 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ca5ae-2fd6-4105-905f-021bc6ab9b23 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:32.430932 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ca5ae-2fd6-4105-905f-021bc6ab9b23 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:32.431247 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ca5ae-2fd6-4105-905f-021bc6ab9b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:32.448148 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-757ca5ae-2fd6-4105-905f-021bc6ab9b23 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:32.449331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-757ca5ae-2fd6-4105-905f-021bc6ab9b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:32.474776 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af316650-ef82-459a-828c-9dcf2264e6ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:32.476440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af316650-ef82-459a-828c-9dcf2264e6ae None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:32.493182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:32.521013 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 40/81] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:32.521792 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ca5ae-2fd6-4105-905f-021bc6ab9b23 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:32.588238 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 42/82] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:35:32.589096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af316650-ef82-459a-828c-9dcf2264e6ae None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:32.603730 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:32.628800 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ca5ae-2fd6-4105-905f-021bc6ab9b23 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:32.663058 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a58fe-f7bc-491d-87b0-6426d4cccb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:32.663676 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a58fe-f7bc-491d-87b0-6426d4cccb04 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:32.663951 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a58fe-f7bc-491d-87b0-6426d4cccb04 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:32.664216 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a58fe-f7bc-491d-87b0-6426d4cccb04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:32.674673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a58fe-f7bc-491d-87b0-6426d4cccb04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-b36a58fe-f7bc-491d-87b0-6426d4cccb04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:32.679391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:32.680232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:32.680952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:32.680952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:32.680952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:32.680952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:32.680952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:32.680952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:32.680952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:32.680952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:32.680952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:32.680952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:32.680952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:32.680952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:32.680952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 41/83] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:32.681605 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a58fe-f7bc-491d-87b0-6426d4cccb04 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:32.693185 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af316650-ef82-459a-828c-9dcf2264e6ae None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:32.714842 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:32.728167 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462188f8-96e8-441d-b40d-490505b3371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:32.728813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462188f8-96e8-441d-b40d-490505b3371e None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:32.729093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462188f8-96e8-441d-b40d-490505b3371e None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:32.729365 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462188f8-96e8-441d-b40d-490505b3371e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:32.780812 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a58fe-f7bc-491d-87b0-6426d4cccb04 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:32.795888 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462188f8-96e8-441d-b40d-490505b3371e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:32.797342 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462188f8-96e8-441d-b40d-490505b3371e None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:32.812520 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:32.814999 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7247e49-27cf-4d4e-b591-550f97d632fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:32.815640 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7247e49-27cf-4d4e-b591-550f97d632fa None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:32.815923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7247e49-27cf-4d4e-b591-550f97d632fa None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:32.816243 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7247e49-27cf-4d4e-b591-550f97d632fa None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:32.817398 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7247e49-27cf-4d4e-b591-550f97d632fa None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:32.818884 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7247e49-27cf-4d4e-b591-550f97d632fa None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:32.820543 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 42/84] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:32 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:32.821300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7247e49-27cf-4d4e-b591-550f97d632fa None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:32.905942 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 43/85] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:35:32.906838 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462188f8-96e8-441d-b40d-490505b3371e None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:32.922256 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7247e49-27cf-4d4e-b591-550f97d632fa None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:32.923828 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:32.957148 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bf5d2-93ba-409c-9a64-3b5e9b3cfa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:32.957783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bf5d2-93ba-409c-9a64-3b5e9b3cfa00 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:32.958062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bf5d2-93ba-409c-9a64-3b5e9b3cfa00 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:32.958333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bf5d2-93ba-409c-9a64-3b5e9b3cfa00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:32.959460 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bf5d2-93ba-409c-9a64-3b5e9b3cfa00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:32.960942 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bf5d2-93ba-409c-9a64-3b5e9b3cfa00 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:32.962527 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 43/86] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:35:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:32.963318 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bf5d2-93ba-409c-9a64-3b5e9b3cfa00 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:33.004626 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462188f8-96e8-441d-b40d-490505b3371e None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:33.018476 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:33.038194 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2f0dd-afc1-4d16-9d92-256d4120fe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:33.038795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f0dd-afc1-4d16-9d92-256d4120fe6e None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:33.039078 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f0dd-afc1-4d16-9d92-256d4120fe6e None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:33.039379 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f0dd-afc1-4d16-9d92-256d4120fe6e None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:33.040524 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2f0dd-afc1-4d16-9d92-256d4120fe6e None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:33.042180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2f0dd-afc1-4d16-9d92-256d4120fe6e None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:33.043842 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 44/87] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:32 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:33.044596 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2f0dd-afc1-4d16-9d92-256d4120fe6e None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:33.065898 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bf5d2-93ba-409c-9a64-3b5e9b3cfa00 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:33.100517 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e2ea4-71c2-4f73-a490-203cd4563bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:33.101145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2ea4-71c2-4f73-a490-203cd4563bba None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:33.101421 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2ea4-71c2-4f73-a490-203cd4563bba None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:33.101681 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2ea4-71c2-4f73-a490-203cd4563bba None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:33.102336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e2ea4-71c2-4f73-a490-203cd4563bba None admin] RBAC: Adding query filter params (name=member) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:33.102663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e2ea4-71c2-4f73-a490-203cd4563bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:33.104193 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e2ea4-71c2-4f73-a490-203cd4563bba None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:33.111954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 44/88] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:35:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:33.112723 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e2ea4-71c2-4f73-a490-203cd4563bba None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:33.144979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:33.149776 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2f0dd-afc1-4d16-9d92-256d4120fe6e None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:33.183993 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d56bf-2de2-44e9-ab32-717a51322c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:33.184607 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d56bf-2de2-44e9-ab32-717a51322c13 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:33.184884 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d56bf-2de2-44e9-ab32-717a51322c13 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:33.185166 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d56bf-2de2-44e9-ab32-717a51322c13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:33.185889 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d56bf-2de2-44e9-ab32-717a51322c13 None admin] RBAC: Adding query filter params (role.id=3b2a5b7c44354447b2bcac96e039c227, scope.project.id=c120cb6ccb334c1787bda6da7e12c849, user.id=f074eceaddb146fab56e8b5769451851) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:33.186196 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d56bf-2de2-44e9-ab32-717a51322c13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:33.187663 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d56bf-2de2-44e9-ab32-717a51322c13 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:33.193057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 45/89] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:33 2022] GET /identity/v3/role_assignments?user.id=f074eceaddb146fab56e8b5769451851&scope.project.id=c120cb6ccb334c1787bda6da7e12c849&role.id=3b2a5b7c44354447b2bcac96e039c227 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:33.193826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d56bf-2de2-44e9-ab32-717a51322c13 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:33.217681 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e2ea4-71c2-4f73-a490-203cd4563bba None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:33.255539 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7a49e-a314-476e-a094-18920a609de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:33.256201 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7a49e-a314-476e-a094-18920a609de8 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:33.256483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7a49e-a314-476e-a094-18920a609de8 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:33.256758 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7a49e-a314-476e-a094-18920a609de8 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:33.258022 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7a49e-a314-476e-a094-18920a609de8 None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:33.259644 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7a49e-a314-476e-a094-18920a609de8 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:33.261704 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 45/90] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:33 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:33.262552 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7a49e-a314-476e-a094-18920a609de8 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:33.274191 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:33.335908 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d56bf-2de2-44e9-ab32-717a51322c13 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:33.377526 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6416ff-3edf-4b19-ba14-3d8fe2f85ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:33.378165 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6416ff-3edf-4b19-ba14-3d8fe2f85ead None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:33.378447 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6416ff-3edf-4b19-ba14-3d8fe2f85ead None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:33.378746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6416ff-3edf-4b19-ba14-3d8fe2f85ead None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:33.379407 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6416ff-3edf-4b19-ba14-3d8fe2f85ead None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:33.380875 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6416ff-3edf-4b19-ba14-3d8fe2f85ead None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:33.387980 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:33.391235 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7a49e-a314-476e-a094-18920a609de8 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:33.406205 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 46/91] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Aug 6 20:35:33 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:35:33.406205 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6416ff-3edf-4b19-ba14-3d8fe2f85ead None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:33.440466 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85995682-2e3e-4147-b74d-ff8bc2771076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:33.441194 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85995682-2e3e-4147-b74d-ff8bc2771076 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:33.441541 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85995682-2e3e-4147-b74d-ff8bc2771076 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:33.441988 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85995682-2e3e-4147-b74d-ff8bc2771076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:33.442836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85995682-2e3e-4147-b74d-ff8bc2771076 None admin] RBAC: Adding query filter params (role.id=e62e78acab6b46f6a866b4980700caae, scope.project.id=c120cb6ccb334c1787bda6da7e12c849, user.id=2d2bdc2d34c34554b4a922abe3128eee) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:33.443240 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85995682-2e3e-4147-b74d-ff8bc2771076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:33.444847 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85995682-2e3e-4147-b74d-ff8bc2771076 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:33.451668 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 46/92] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:33 2022] GET /identity/v3/role_assignments?user.id=2d2bdc2d34c34554b4a922abe3128eee&scope.project.id=c120cb6ccb334c1787bda6da7e12c849&role.id=e62e78acab6b46f6a866b4980700caae => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:33.452643 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85995682-2e3e-4147-b74d-ff8bc2771076 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:33.611143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6416ff-3edf-4b19-ba14-3d8fe2f85ead None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:33.613296 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:33.654066 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85995682-2e3e-4147-b74d-ff8bc2771076 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:33.660988 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950bd9e-8362-4306-b06f-d3c59694ef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:33.662116 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950bd9e-8362-4306-b06f-d3c59694ef6e None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:33.662638 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950bd9e-8362-4306-b06f-d3c59694ef6e None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:33.663120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950bd9e-8362-4306-b06f-d3c59694ef6e None admin] PATH_INFO: `/v3/users/f074eceaddb146fab56e8b5769451851` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:33.665261 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950bd9e-8362-4306-b06f-d3c59694ef6e None admin] RBAC: Authorizing `identity:get_user(user_id=f074eceaddb146fab56e8b5769451851)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:33.667287 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950bd9e-8362-4306-b06f-d3c59694ef6e None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:33.675475 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 47/93] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:33 2022] GET /identity/v3/users/f074eceaddb146fab56e8b5769451851 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:33.676815 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950bd9e-8362-4306-b06f-d3c59694ef6e None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:33.712057 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c47b44-08c3-4df8-b3dd-d02a22e10888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:33.713812 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c47b44-08c3-4df8-b3dd-d02a22e10888 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:33.714955 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c47b44-08c3-4df8-b3dd-d02a22e10888 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:33.715231 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c47b44-08c3-4df8-b3dd-d02a22e10888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:33.715987 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c47b44-08c3-4df8-b3dd-d02a22e10888 None admin] RBAC: Adding query filter params (role.id=273b4b42102c497baaeced73ebb2ba7f, scope.project.id=c120cb6ccb334c1787bda6da7e12c849, user.id=f074eceaddb146fab56e8b5769451851) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:33.716308 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c47b44-08c3-4df8-b3dd-d02a22e10888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:33.717785 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c47b44-08c3-4df8-b3dd-d02a22e10888 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:33.724840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 47/94] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:33 2022] GET /identity/v3/role_assignments?user.id=f074eceaddb146fab56e8b5769451851&scope.project.id=c120cb6ccb334c1787bda6da7e12c849&role.id=273b4b42102c497baaeced73ebb2ba7f => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:33.809025 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950bd9e-8362-4306-b06f-d3c59694ef6e None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:33.855127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b7315-1de0-4df2-978e-4a8dbaf9e601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:33.856217 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7315-1de0-4df2-978e-4a8dbaf9e601 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:33.856693 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7315-1de0-4df2-978e-4a8dbaf9e601 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:33.857161 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7315-1de0-4df2-978e-4a8dbaf9e601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:33.909922 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:33.948442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b7315-1de0-4df2-978e-4a8dbaf9e601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:33.949960 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b7315-1de0-4df2-978e-4a8dbaf9e601 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:34.059854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 48/95] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:35:34.065678 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c47b44-08c3-4df8-b3dd-d02a22e10888 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:34.096800 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:34.171483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c47b44-08c3-4df8-b3dd-d02a22e10888 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:34.206741 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5597f8-ffd0-4f64-9628-35e7b832c4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:34.207395 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5597f8-ffd0-4f64-9628-35e7b832c4d6 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:34.207675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5597f8-ffd0-4f64-9628-35e7b832c4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:34.207950 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5597f8-ffd0-4f64-9628-35e7b832c4d6 None admin] PATH_INFO: `/v3/projects/7c483e3f3be1480996781758a7afc82c` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:34.209100 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5597f8-ffd0-4f64-9628-35e7b832c4d6 None admin] RBAC: Authorizing `identity:get_project(project_id=7c483e3f3be1480996781758a7afc82c)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:34.210565 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5597f8-ffd0-4f64-9628-35e7b832c4d6 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:34.212764 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 48/96] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:34 2022] GET /identity/v3/projects/7c483e3f3be1480996781758a7afc82c => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:34.219247 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b7315-1de0-4df2-978e-4a8dbaf9e601 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:34.298106 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:34.334853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b7315-1de0-4df2-978e-4a8dbaf9e601 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:34.380829 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d89be-5bad-4e0f-841e-e18bad24f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:34.381458 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d89be-5bad-4e0f-841e-e18bad24f187 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:34.381740 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d89be-5bad-4e0f-841e-e18bad24f187 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:34.382018 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d89be-5bad-4e0f-841e-e18bad24f187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:34.382792 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d89be-5bad-4e0f-841e-e18bad24f187 None admin] RBAC: Adding query filter params (role.id=3b2a5b7c44354447b2bcac96e039c227, scope.project.id=7c483e3f3be1480996781758a7afc82c, user.id=f074eceaddb146fab56e8b5769451851) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:34.383239 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d89be-5bad-4e0f-841e-e18bad24f187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:34.384598 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d89be-5bad-4e0f-841e-e18bad24f187 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:34.395306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 49/97] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:34 2022] GET /identity/v3/role_assignments?user.id=f074eceaddb146fab56e8b5769451851&scope.project.id=7c483e3f3be1480996781758a7afc82c&role.id=3b2a5b7c44354447b2bcac96e039c227 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:36.081843 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c65c5d-cc5c-4318-8537-a3277b67d6cf None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:36.082871 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c65c5d-cc5c-4318-8537-a3277b67d6cf None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:36.083351 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c65c5d-cc5c-4318-8537-a3277b67d6cf None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:36.085129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 49/98] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:36.091025 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa1834-4ad1-4a09-af59-b0b163ec106c None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:36.091895 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa1834-4ad1-4a09-af59-b0b163ec106c None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:36.092380 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa1834-4ad1-4a09-af59-b0b163ec106c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:36.123631 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-e8fa1834-4ad1-4a09-af59-b0b163ec106c None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:36.125208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-e8fa1834-4ad1-4a09-af59-b0b163ec106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:36.221946 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 50/99] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:35:36.259942 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c65c5d-cc5c-4318-8537-a3277b67d6cf None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:36.388671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:36.399154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c65c5d-cc5c-4318-8537-a3277b67d6cf None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:36.409984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572dba5-eb65-4fa3-ac65-c61399838b0f None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:36.410561 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572dba5-eb65-4fa3-ac65-c61399838b0f None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:36.411087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572dba5-eb65-4fa3-ac65-c61399838b0f None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:36.413267 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 51/100] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:36.419019 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b928809-4598-4c8e-8d2e-610822976092 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:36.419738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b928809-4598-4c8e-8d2e-610822976092 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:36.420253 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b928809-4598-4c8e-8d2e-610822976092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:36.458926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-0b928809-4598-4c8e-8d2e-610822976092 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:36.459273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a31ea-3c6c-4855-9295-f73876f50692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:36.459935 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a31ea-3c6c-4855-9295-f73876f50692 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:36.460172 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-0b928809-4598-4c8e-8d2e-610822976092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:36.460273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a31ea-3c6c-4855-9295-f73876f50692 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:36.460480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a31ea-3c6c-4855-9295-f73876f50692 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:36.499556 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a31ea-3c6c-4855-9295-f73876f50692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-9a3a31ea-3c6c-4855-9295-f73876f50692 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:36.504331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:36.505153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:36.505905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:36.505905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:36.505905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:36.505905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:36.505905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:36.505905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:36.505905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:36.505905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:36.505905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:36.505905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:36.505905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:36.505905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:36.505905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 50/101] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:36.515598 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a31ea-3c6c-4855-9295-f73876f50692 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:36.544048 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:36.559588 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 52/102] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:35:36.591630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b928809-4598-4c8e-8d2e-610822976092 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:36.717416 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a31ea-3c6c-4855-9295-f73876f50692 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:36.793925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed71915-25bf-4e40-bfb8-d9c110108d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:36.794550 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed71915-25bf-4e40-bfb8-d9c110108d9b None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:36.794857 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed71915-25bf-4e40-bfb8-d9c110108d9b None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:36.795124 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed71915-25bf-4e40-bfb8-d9c110108d9b None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:36.795794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed71915-25bf-4e40-bfb8-d9c110108d9b None admin] RBAC: Adding query filter params (name=member) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:36.796093 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed71915-25bf-4e40-bfb8-d9c110108d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:36.797509 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed71915-25bf-4e40-bfb8-d9c110108d9b None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:36.811980 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b928809-4598-4c8e-8d2e-610822976092 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:36.816941 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 51/103] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:35:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:36.822514 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed71915-25bf-4e40-bfb8-d9c110108d9b None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:36.875429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:36.895997 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba868e-d379-412c-b113-c393480d5389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:36.896654 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba868e-d379-412c-b113-c393480d5389 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:36.896943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba868e-d379-412c-b113-c393480d5389 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:36.898625 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba868e-d379-412c-b113-c393480d5389 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:36.929799 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba868e-d379-412c-b113-c393480d5389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-8bba868e-d379-412c-b113-c393480d5389 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:36.934790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:36.935615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:36.936351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:36.936351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:36.936351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:36.936351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:36.936351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:36.936351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:36.936351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:36.936351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:36.936351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:36.936351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:36.936351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:36.936351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:35:36.936351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 53/104] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:35:36.942155 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56665126-fb11-4657-ba74-b5fe8e61f45a None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:36.942155 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56665126-fb11-4657-ba74-b5fe8e61f45a None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:36.942155 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56665126-fb11-4657-ba74-b5fe8e61f45a None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:36.950975 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 54/105] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:36 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:36.954705 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56665126-fb11-4657-ba74-b5fe8e61f45a None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:37.016494 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed71915-25bf-4e40-bfb8-d9c110108d9b None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:37.038637 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:37.051603 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cd4f4-037a-4bbb-8fa5-23385f78233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:37.052260 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cd4f4-037a-4bbb-8fa5-23385f78233a None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:37.052643 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cd4f4-037a-4bbb-8fa5-23385f78233a None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:37.053013 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cd4f4-037a-4bbb-8fa5-23385f78233a None admin] PATH_INFO: `/v3/users/f074eceaddb146fab56e8b5769451851` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:37.054303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cd4f4-037a-4bbb-8fa5-23385f78233a None admin] RBAC: Authorizing `identity:get_user(user_id=f074eceaddb146fab56e8b5769451851)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:37.056218 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cd4f4-037a-4bbb-8fa5-23385f78233a None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:37.058104 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 52/106] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:36 2022] GET /identity/v3/users/f074eceaddb146fab56e8b5769451851 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:37.063693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52a9da-f5d2-4769-bdd9-8fd5d38ea5b1 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:37.064083 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52a9da-f5d2-4769-bdd9-8fd5d38ea5b1 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:37.064451 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52a9da-f5d2-4769-bdd9-8fd5d38ea5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:37.083709 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-5e52a9da-f5d2-4769-bdd9-8fd5d38ea5b1 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:37.085037 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-5e52a9da-f5d2-4769-bdd9-8fd5d38ea5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:37.093134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56665126-fb11-4657-ba74-b5fe8e61f45a None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:37.130357 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88645b0-56e1-42d9-bcbf-b4ff1186c8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:37.131275 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88645b0-56e1-42d9-bcbf-b4ff1186c8f1 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:37.131771 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88645b0-56e1-42d9-bcbf-b4ff1186c8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:37.132236 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88645b0-56e1-42d9-bcbf-b4ff1186c8f1 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:37.133086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88645b0-56e1-42d9-bcbf-b4ff1186c8f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:37.133618 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88645b0-56e1-42d9-bcbf-b4ff1186c8f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:37.135283 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88645b0-56e1-42d9-bcbf-b4ff1186c8f1 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:37.144550 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 55/107] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:37.145976 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35287474-4444-48b7-95b1-0e0ba1350df8 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:37.146533 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35287474-4444-48b7-95b1-0e0ba1350df8 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:37.147108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35287474-4444-48b7-95b1-0e0ba1350df8 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:37.148500 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 56/108] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:37.149476 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35287474-4444-48b7-95b1-0e0ba1350df8 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:37.162931 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 53/109] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:37.168193 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52a9da-f5d2-4769-bdd9-8fd5d38ea5b1 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:37.200649 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:37.291636 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52a9da-f5d2-4769-bdd9-8fd5d38ea5b1 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:37.303523 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35287474-4444-48b7-95b1-0e0ba1350df8 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:37.328890 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:37.330363 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f32b9-c912-49c2-a660-04a7de3aa1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:37.331304 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f32b9-c912-49c2-a660-04a7de3aa1f0 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:37.331758 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f32b9-c912-49c2-a660-04a7de3aa1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:37.332389 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f32b9-c912-49c2-a660-04a7de3aa1f0 None admin] PATH_INFO: `/v3/users/2d2bdc2d34c34554b4a922abe3128eee` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:37.333640 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f32b9-c912-49c2-a660-04a7de3aa1f0 None admin] RBAC: Authorizing `identity:get_user(user_id=2d2bdc2d34c34554b4a922abe3128eee)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:37.335443 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f32b9-c912-49c2-a660-04a7de3aa1f0 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:37.338257 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 54/110] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:37 2022] GET /identity/v3/users/2d2bdc2d34c34554b4a922abe3128eee => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:37.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd27a-2b9e-40f4-b4c1-7e8afcbbfacd None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:37.340942 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd27a-2b9e-40f4-b4c1-7e8afcbbfacd None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:37.340942 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd27a-2b9e-40f4-b4c1-7e8afcbbfacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:37.354452 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578c41c-9f9a-4c58-a0cc-a8bee7d4db33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:37.355385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578c41c-9f9a-4c58-a0cc-a8bee7d4db33 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:37.355796 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578c41c-9f9a-4c58-a0cc-a8bee7d4db33 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:37.356970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578c41c-9f9a-4c58-a0cc-a8bee7d4db33 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:37.358636 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578c41c-9f9a-4c58-a0cc-a8bee7d4db33 None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:37.360331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578c41c-9f9a-4c58-a0cc-a8bee7d4db33 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:37.362420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 57/111] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:37 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:37.363391 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578c41c-9f9a-4c58-a0cc-a8bee7d4db33 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:37.366670 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-df0fd27a-2b9e-40f4-b4c1-7e8afcbbfacd None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:37.368668 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-df0fd27a-2b9e-40f4-b4c1-7e8afcbbfacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:37.447789 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 55/112] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:37.453628 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fd27a-2b9e-40f4-b4c1-7e8afcbbfacd None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:37.478844 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578c41c-9f9a-4c58-a0cc-a8bee7d4db33 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:37.501144 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:37.516525 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ee5c2-138d-4602-9a55-7d6595aba689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:37.517307 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ee5c2-138d-4602-9a55-7d6595aba689 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:37.517457 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ee5c2-138d-4602-9a55-7d6595aba689 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:37.517701 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ee5c2-138d-4602-9a55-7d6595aba689 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:37.529243 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ee5c2-138d-4602-9a55-7d6595aba689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-c73ee5c2-138d-4602-9a55-7d6595aba689 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:37.534630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:37.535459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:37.536188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:37.536188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:37.536188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:37.536188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:37.536188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:37.536188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:37.536188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:37.536188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:37.536188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:37.536188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:37.536188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:35:37.536188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:35:37.536188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 58/113] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:35:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:37.542025 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ee5c2-138d-4602-9a55-7d6595aba689 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:37.589478 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:37.595260 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fd27a-2b9e-40f4-b4c1-7e8afcbbfacd None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:37.632512 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71301e-636a-423b-a698-9fe0f0173bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:37.633242 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71301e-636a-423b-a698-9fe0f0173bad None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:37.633527 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71301e-636a-423b-a698-9fe0f0173bad None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:37.633792 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71301e-636a-423b-a698-9fe0f0173bad None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:37.634997 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71301e-636a-423b-a698-9fe0f0173bad None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:37.636593 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71301e-636a-423b-a698-9fe0f0173bad None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:37.643091 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 56/114] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:37 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:37.643091 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecda6f-e05c-4699-94bb-19624314b0e1 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:37.643091 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecda6f-e05c-4699-94bb-19624314b0e1 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:37.643091 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecda6f-e05c-4699-94bb-19624314b0e1 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:37.643401 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 57/115] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:37.643908 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecda6f-e05c-4699-94bb-19624314b0e1 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:37.653936 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ee5c2-138d-4602-9a55-7d6595aba689 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:37.693512 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f54636-b046-4693-abe0-96f017d1eb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:37.695382 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f54636-b046-4693-abe0-96f017d1eb20 None admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:37.696098 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f54636-b046-4693-abe0-96f017d1eb20 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:37.696921 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f54636-b046-4693-abe0-96f017d1eb20 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849/users/f074eceaddb146fab56e8b5769451851/roles/3b2a5b7c44354447b2bcac96e039c227` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:37.701235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f54636-b046-4693-abe0-96f017d1eb20 None admin] RBAC: Authorizing `identity:create_grant(project_id=c120cb6ccb334c1787bda6da7e12c849, user_id=f074eceaddb146fab56e8b5769451851, role_id=3b2a5b7c44354447b2bcac96e039c227)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:37.704083 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f54636-b046-4693-abe0-96f017d1eb20 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:37.730619 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 59/116] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:35:37 2022] PUT /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849/users/f074eceaddb146fab56e8b5769451851/roles/3b2a5b7c44354447b2bcac96e039c227 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:35:37.730619 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f54636-b046-4693-abe0-96f017d1eb20 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:37.773983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:37.801692 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecda6f-e05c-4699-94bb-19624314b0e1 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:37.849188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f54636-b046-4693-abe0-96f017d1eb20 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:37.853959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:37.858206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0332279-4ec5-4bcd-910b-b1053b9f465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:37.859018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0332279-4ec5-4bcd-910b-b1053b9f465c None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:37.859363 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0332279-4ec5-4bcd-910b-b1053b9f465c None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:37.860406 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0332279-4ec5-4bcd-910b-b1053b9f465c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:37.876800 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0332279-4ec5-4bcd-910b-b1053b9f465c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-f0332279-4ec5-4bcd-910b-b1053b9f465c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:37.884111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:37.885209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:37.885958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:37.885958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:37.885958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:37.885958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:37.885958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:37.885958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:37.885958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:37.885958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:37.885958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:37.885958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:37.885958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:35:37.885958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:37.887052 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 58/117] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:37.887839 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0332279-4ec5-4bcd-910b-b1053b9f465c None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:37.900153 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4e9f5-57e7-4dc3-9491-74b5c2e6f2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:37.900848 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4e9f5-57e7-4dc3-9491-74b5c2e6f2cf None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:37.901127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4e9f5-57e7-4dc3-9491-74b5c2e6f2cf None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:37.901398 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4e9f5-57e7-4dc3-9491-74b5c2e6f2cf None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:37.902135 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4e9f5-57e7-4dc3-9491-74b5c2e6f2cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:37.902443 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4e9f5-57e7-4dc3-9491-74b5c2e6f2cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:37.903922 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4e9f5-57e7-4dc3-9491-74b5c2e6f2cf None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:37.913657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 60/118] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:35:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:37.915079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28373c55-b89d-463f-95d2-270ceae42ca9 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:37.915445 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28373c55-b89d-463f-95d2-270ceae42ca9 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:37.915729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28373c55-b89d-463f-95d2-270ceae42ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:37.941825 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-28373c55-b89d-463f-95d2-270ceae42ca9 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:37.943585 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-28373c55-b89d-463f-95d2-270ceae42ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:38.018093 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0332279-4ec5-4bcd-910b-b1053b9f465c None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:38.020438 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 61/119] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:38.022634 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28373c55-b89d-463f-95d2-270ceae42ca9 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:38.064133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a630ed6-5789-4ee0-b9c9-c12262383b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:38.065052 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a630ed6-5789-4ee0-b9c9-c12262383b64 None admin] REQUEST_METHOD: `PUT` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:38.065495 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a630ed6-5789-4ee0-b9c9-c12262383b64 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:38.065770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a630ed6-5789-4ee0-b9c9-c12262383b64 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849/users/2d2bdc2d34c34554b4a922abe3128eee/roles/e62e78acab6b46f6a866b4980700caae` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:38.067814 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a630ed6-5789-4ee0-b9c9-c12262383b64 None admin] RBAC: Authorizing `identity:create_grant(project_id=c120cb6ccb334c1787bda6da7e12c849, user_id=2d2bdc2d34c34554b4a922abe3128eee, role_id=e62e78acab6b46f6a866b4980700caae)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:38.069342 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a630ed6-5789-4ee0-b9c9-c12262383b64 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:38.085603 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 59/120] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:35:37 2022] PUT /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849/users/2d2bdc2d34c34554b4a922abe3128eee/roles/e62e78acab6b46f6a866b4980700caae => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:35:38.093350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a630ed6-5789-4ee0-b9c9-c12262383b64 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:38.097433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:38.143060 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:38.149883 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28373c55-b89d-463f-95d2-270ceae42ca9 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:38.190985 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e72d96-cbb4-456b-bdc4-fcb5a37e917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:38.192392 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e72d96-cbb4-456b-bdc4-fcb5a37e917f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:38.192392 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e72d96-cbb4-456b-bdc4-fcb5a37e917f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:38.192392 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e72d96-cbb4-456b-bdc4-fcb5a37e917f None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:38.192934 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e72d96-cbb4-456b-bdc4-fcb5a37e917f None admin] RBAC: Adding query filter params (name=reader) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:38.193244 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e72d96-cbb4-456b-bdc4-fcb5a37e917f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:38.194739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e72d96-cbb4-456b-bdc4-fcb5a37e917f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:38.204820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 62/121] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:35:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:38.206380 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d273bd-0040-4d09-abd7-a204775ba5aa None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:38.206730 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d273bd-0040-4d09-abd7-a204775ba5aa None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:38.207312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d273bd-0040-4d09-abd7-a204775ba5aa None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:38.213480 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 63/122] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:38.214453 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d273bd-0040-4d09-abd7-a204775ba5aa None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:38.230221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a630ed6-5789-4ee0-b9c9-c12262383b64 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:38.271394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f29290-edec-4408-8d27-4354d70bb8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:38.272582 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f29290-edec-4408-8d27-4354d70bb8bb None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:38.273057 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f29290-edec-4408-8d27-4354d70bb8bb None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:38.273480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f29290-edec-4408-8d27-4354d70bb8bb None admin] PATH_INFO: `/v3/users/f074eceaddb146fab56e8b5769451851` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:38.274908 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f29290-edec-4408-8d27-4354d70bb8bb None admin] RBAC: Authorizing `identity:get_user(user_id=f074eceaddb146fab56e8b5769451851)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:38.276765 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f29290-edec-4408-8d27-4354d70bb8bb None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:38.278671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 60/123] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:38 2022] GET /identity/v3/users/f074eceaddb146fab56e8b5769451851 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:38.279749 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f29290-edec-4408-8d27-4354d70bb8bb None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:38.329054 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d273bd-0040-4d09-abd7-a204775ba5aa None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:38.364008 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:38.374725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951709a-5548-4aa7-b6c6-fbd515192328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:38.375380 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951709a-5548-4aa7-b6c6-fbd515192328 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:38.375662 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951709a-5548-4aa7-b6c6-fbd515192328 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:38.376347 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951709a-5548-4aa7-b6c6-fbd515192328 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:38.377889 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951709a-5548-4aa7-b6c6-fbd515192328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:38.379693 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951709a-5548-4aa7-b6c6-fbd515192328 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:38.381928 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 64/124] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:35:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:38.383554 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e22b87-4622-471e-baf6-d28f1ed9e1b9 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:38.383839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e22b87-4622-471e-baf6-d28f1ed9e1b9 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:38.384318 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e22b87-4622-471e-baf6-d28f1ed9e1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:38.400971 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f29290-edec-4408-8d27-4354d70bb8bb None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:38.407313 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-c2e22b87-4622-471e-baf6-d28f1ed9e1b9 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:38.408978 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-c2e22b87-4622-471e-baf6-d28f1ed9e1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:38.435505 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fb52d-d014-4507-8415-f9d3c01abf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:38.436265 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:38.437377 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb52d-d014-4507-8415-f9d3c01abf7c None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:38.437876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb52d-d014-4507-8415-f9d3c01abf7c None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:38.438358 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb52d-d014-4507-8415-f9d3c01abf7c None admin] PATH_INFO: `/v3/users/ac471b75500c41498bd52e22c4fa0555` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:38.453338 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fb52d-d014-4507-8415-f9d3c01abf7c None admin] RBAC: Authorizing `identity:get_user(user_id=ac471b75500c41498bd52e22c4fa0555)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:38.455310 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fb52d-d014-4507-8415-f9d3c01abf7c None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:38.457095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 61/125] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:38 2022] GET /identity/v3/users/ac471b75500c41498bd52e22c4fa0555 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:38.462294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fb52d-d014-4507-8415-f9d3c01abf7c None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:38.496531 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 65/126] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:38.499402 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e22b87-4622-471e-baf6-d28f1ed9e1b9 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:38.606668 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fb52d-d014-4507-8415-f9d3c01abf7c None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:38.623191 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e22b87-4622-471e-baf6-d28f1ed9e1b9 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:38.643288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:38.653851 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b75f6b-74ca-4ada-b75b-5944ea18d961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:38.654771 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b75f6b-74ca-4ada-b75b-5944ea18d961 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:38.655057 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b75f6b-74ca-4ada-b75b-5944ea18d961 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:38.655334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b75f6b-74ca-4ada-b75b-5944ea18d961 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:38.657154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b75f6b-74ca-4ada-b75b-5944ea18d961 None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:38.659336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b75f6b-74ca-4ada-b75b-5944ea18d961 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:38.666368 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 62/127] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:38 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:38.666368 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b75f6b-74ca-4ada-b75b-5944ea18d961 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:38.680662 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014e44f-7900-4bd8-9433-af0dd8393ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:38.681509 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014e44f-7900-4bd8-9433-af0dd8393ca8 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:38.681930 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014e44f-7900-4bd8-9433-af0dd8393ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:38.682423 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014e44f-7900-4bd8-9433-af0dd8393ca8 None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:38.683389 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014e44f-7900-4bd8-9433-af0dd8393ca8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:38.685070 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014e44f-7900-4bd8-9433-af0dd8393ca8 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:38.719395 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 66/128] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Aug 6 20:35:38 2022] POST /identity/v3/projects => generated 302 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:35:38.721189 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014e44f-7900-4bd8-9433-af0dd8393ca8 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:38.736418 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:38.803172 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b75f6b-74ca-4ada-b75b-5944ea18d961 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:38.847628 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014e44f-7900-4bd8-9433-af0dd8393ca8 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:38.850429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31eda5-fdc9-4f14-82c8-5dadf36111e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:38.852272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31eda5-fdc9-4f14-82c8-5dadf36111e9 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:38.852557 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31eda5-fdc9-4f14-82c8-5dadf36111e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:38.852870 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31eda5-fdc9-4f14-82c8-5dadf36111e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:38.899151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f58419-d8a9-4591-823a-7c566a9dd338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:38.899902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f58419-d8a9-4591-823a-7c566a9dd338 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:38.900643 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f58419-d8a9-4591-823a-7c566a9dd338 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:38.900643 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f58419-d8a9-4591-823a-7c566a9dd338 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:38.914106 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f58419-d8a9-4591-823a-7c566a9dd338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-92f58419-d8a9-4591-823a-7c566a9dd338 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:38.921149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:38.922090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:38.922907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:38.922907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:38.922907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:38.922907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:38.922907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:38.922907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:38.922907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:38.922907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:38.922907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:38.922907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:38.922907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:38.922907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:35:38.927194 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 67/129] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:38.928179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f58419-d8a9-4591-823a-7c566a9dd338 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:38.991768 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:39.001660 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31eda5-fdc9-4f14-82c8-5dadf36111e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:39.003782 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31eda5-fdc9-4f14-82c8-5dadf36111e9 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:39.022730 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:39.071154 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f58419-d8a9-4591-823a-7c566a9dd338 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:39.112879 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab99e5-b4a0-48d5-a11b-8bf953538838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:39.113576 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab99e5-b4a0-48d5-a11b-8bf953538838 None admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:39.113855 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab99e5-b4a0-48d5-a11b-8bf953538838 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:39.114128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab99e5-b4a0-48d5-a11b-8bf953538838 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849/users/f074eceaddb146fab56e8b5769451851/roles/273b4b42102c497baaeced73ebb2ba7f` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:39.116400 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab99e5-b4a0-48d5-a11b-8bf953538838 None admin] RBAC: Authorizing `identity:create_grant(project_id=c120cb6ccb334c1787bda6da7e12c849, user_id=f074eceaddb146fab56e8b5769451851, role_id=273b4b42102c497baaeced73ebb2ba7f)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:39.117864 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab99e5-b4a0-48d5-a11b-8bf953538838 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:39.141588 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 68/131] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:35:38 2022] PUT /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849/users/f074eceaddb146fab56e8b5769451851/roles/273b4b42102c497baaeced73ebb2ba7f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:35:39.141785 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 63/131] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:35:39.142517 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31eda5-fdc9-4f14-82c8-5dadf36111e9 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:39.151989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab99e5-b4a0-48d5-a11b-8bf953538838 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:39.272126 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:39.281210 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31eda5-fdc9-4f14-82c8-5dadf36111e9 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:39.324597 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14034f6c-4d02-4445-84fe-ae83fdf9b0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:39.325617 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14034f6c-4d02-4445-84fe-ae83fdf9b0df None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:39.326145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14034f6c-4d02-4445-84fe-ae83fdf9b0df None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:39.326647 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14034f6c-4d02-4445-84fe-ae83fdf9b0df None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:39.327618 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14034f6c-4d02-4445-84fe-ae83fdf9b0df None admin] RBAC: Adding query filter params (name=member) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:39.328381 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14034f6c-4d02-4445-84fe-ae83fdf9b0df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:39.330026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14034f6c-4d02-4445-84fe-ae83fdf9b0df None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:39.341344 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 64/132] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:35:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:39.347462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14034f6c-4d02-4445-84fe-ae83fdf9b0df None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:39.441772 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab99e5-b4a0-48d5-a11b-8bf953538838 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:39.479594 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14034f6c-4d02-4445-84fe-ae83fdf9b0df None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:39.520778 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1afc37-3722-4afb-9e1d-e9416e107897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:39.521560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1afc37-3722-4afb-9e1d-e9416e107897 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:39.521910 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1afc37-3722-4afb-9e1d-e9416e107897 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:39.522259 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1afc37-3722-4afb-9e1d-e9416e107897 None admin] PATH_INFO: `/v3/users/f074eceaddb146fab56e8b5769451851` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:39.523792 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1afc37-3722-4afb-9e1d-e9416e107897 None admin] RBAC: Authorizing `identity:get_user(user_id=f074eceaddb146fab56e8b5769451851)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:39.526174 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1afc37-3722-4afb-9e1d-e9416e107897 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:39.528152 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:39.529778 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 65/133] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:39 2022] GET /identity/v3/users/f074eceaddb146fab56e8b5769451851 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:39.535449 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1afc37-3722-4afb-9e1d-e9416e107897 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:39.552021 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88953e91-5fcd-4da1-b50d-0f286c70876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:39.552688 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88953e91-5fcd-4da1-b50d-0f286c70876d None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:39.552971 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88953e91-5fcd-4da1-b50d-0f286c70876d None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:39.553249 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88953e91-5fcd-4da1-b50d-0f286c70876d None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:39.556154 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88953e91-5fcd-4da1-b50d-0f286c70876d None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:39.559208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88953e91-5fcd-4da1-b50d-0f286c70876d None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:39.561154 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 69/134] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:39 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:39.567873 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88953e91-5fcd-4da1-b50d-0f286c70876d None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:39.583850 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:39.694290 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1afc37-3722-4afb-9e1d-e9416e107897 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:39.750282 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02cab0-4d7f-4dfe-a0fc-2baa4b532a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:39.750962 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02cab0-4d7f-4dfe-a0fc-2baa4b532a84 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:39.751244 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02cab0-4d7f-4dfe-a0fc-2baa4b532a84 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:39.751534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02cab0-4d7f-4dfe-a0fc-2baa4b532a84 None admin] PATH_INFO: `/v3/projects/7c483e3f3be1480996781758a7afc82c` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:39.755059 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02cab0-4d7f-4dfe-a0fc-2baa4b532a84 None admin] RBAC: Authorizing `identity:get_project(project_id=7c483e3f3be1480996781758a7afc82c)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:39.756541 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02cab0-4d7f-4dfe-a0fc-2baa4b532a84 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:39.763040 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 66/135] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:39 2022] GET /identity/v3/projects/7c483e3f3be1480996781758a7afc82c => generated 312 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:39.763908 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02cab0-4d7f-4dfe-a0fc-2baa4b532a84 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:39.789394 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88953e91-5fcd-4da1-b50d-0f286c70876d None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:39.858182 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec80128-e5c1-43f6-bd1a-2c7b9493d015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:39.858837 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec80128-e5c1-43f6-bd1a-2c7b9493d015 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:39.859123 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec80128-e5c1-43f6-bd1a-2c7b9493d015 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:39.859402 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec80128-e5c1-43f6-bd1a-2c7b9493d015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:39.861698 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec80128-e5c1-43f6-bd1a-2c7b9493d015 None admin] RBAC: Adding query filter params (role.id=895af4bcf7524c659872539f2eb1eebe, scope.project.id=c120cb6ccb334c1787bda6da7e12c849, user.id=ac471b75500c41498bd52e22c4fa0555) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:39.862016 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec80128-e5c1-43f6-bd1a-2c7b9493d015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:39.864471 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec80128-e5c1-43f6-bd1a-2c7b9493d015 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:39.877659 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 70/136] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:39 2022] GET /identity/v3/role_assignments?user.id=ac471b75500c41498bd52e22c4fa0555&scope.project.id=c120cb6ccb334c1787bda6da7e12c849&role.id=895af4bcf7524c659872539f2eb1eebe => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:39.940877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:39.953223 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02cab0-4d7f-4dfe-a0fc-2baa4b532a84 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:40.000474 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377c4cc-721e-4719-8b1f-62075b406d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:40.001174 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377c4cc-721e-4719-8b1f-62075b406d90 None admin] REQUEST_METHOD: `PUT` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:40.001450 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377c4cc-721e-4719-8b1f-62075b406d90 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:40.001724 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377c4cc-721e-4719-8b1f-62075b406d90 None admin] PATH_INFO: `/v3/projects/7c483e3f3be1480996781758a7afc82c/users/f074eceaddb146fab56e8b5769451851/roles/3b2a5b7c44354447b2bcac96e039c227` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:40.003694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377c4cc-721e-4719-8b1f-62075b406d90 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c483e3f3be1480996781758a7afc82c, user_id=f074eceaddb146fab56e8b5769451851, role_id=3b2a5b7c44354447b2bcac96e039c227)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:40.005284 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377c4cc-721e-4719-8b1f-62075b406d90 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:40.021717 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 67/137] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:35:39 2022] PUT /identity/v3/projects/7c483e3f3be1480996781758a7afc82c/users/f074eceaddb146fab56e8b5769451851/roles/3b2a5b7c44354447b2bcac96e039c227 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:35:40.517079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244267ee-2988-42e5-b490-839e7ccb71a6 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:40.517588 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244267ee-2988-42e5-b490-839e7ccb71a6 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:40.517659 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244267ee-2988-42e5-b490-839e7ccb71a6 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:40.519164 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 71/138] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:40.526503 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17669-c6ac-4418-b00c-9cd955e9dfa6 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:40.527078 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17669-c6ac-4418-b00c-9cd955e9dfa6 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:40.527078 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17669-c6ac-4418-b00c-9cd955e9dfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:40.563366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-61b17669-c6ac-4418-b00c-9cd955e9dfa6 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:40.564610 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-61b17669-c6ac-4418-b00c-9cd955e9dfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:40.666326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 68/139] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:35:40.689201 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a979ff-8a30-4541-85f7-073dbac5c524 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:40.689520 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a979ff-8a30-4541-85f7-073dbac5c524 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:40.689755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a979ff-8a30-4541-85f7-073dbac5c524 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:40.691129 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 72/140] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:40.696339 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfc400-c608-4441-885e-b6dba0f7578e None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:40.697070 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfc400-c608-4441-885e-b6dba0f7578e None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:40.697070 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfc400-c608-4441-885e-b6dba0f7578e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:40.712125 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a979ff-8a30-4541-85f7-073dbac5c524 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:40.716420 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-62bfc400-c608-4441-885e-b6dba0f7578e None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:40.722606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-62bfc400-c608-4441-885e-b6dba0f7578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:40.798893 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 69/141] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:40.826000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfc400-c608-4441-885e-b6dba0f7578e None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:40.849701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:40.861277 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:40.928220 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a979ff-8a30-4541-85f7-073dbac5c524 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:40.936580 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfc400-c608-4441-885e-b6dba0f7578e None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:40.973345 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30265014-88a0-4b58-a9f8-8f1376a6a295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:40.974066 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30265014-88a0-4b58-a9f8-8f1376a6a295 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:40.974348 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30265014-88a0-4b58-a9f8-8f1376a6a295 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:40.974644 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30265014-88a0-4b58-a9f8-8f1376a6a295 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:40.985925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30265014-88a0-4b58-a9f8-8f1376a6a295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:40.987836 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25de64-7b4e-4ed0-b77c-d649f9984a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:40.988484 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25de64-7b4e-4ed0-b77c-d649f9984a69 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:40.988768 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25de64-7b4e-4ed0-b77c-d649f9984a69 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:40.989036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25de64-7b4e-4ed0-b77c-d649f9984a69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-30265014-88a0-4b58-a9f8-8f1376a6a295 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:40.990694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:40.992775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:40.994770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:40.994770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:40.994770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:40.994770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:40.994770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:40.994770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:40.994770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:40.994770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:40.994770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:40.994770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:40.994770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:40.994770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:40.998847 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 70/142] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:35:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:41.002566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30265014-88a0-4b58-a9f8-8f1376a6a295 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:41.008269 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25de64-7b4e-4ed0-b77c-d649f9984a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-2f25de64-7b4e-4ed0-b77c-d649f9984a69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:41.013994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:41.016086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:41.018044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:41.018044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:41.018044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:41.018044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:41.018044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:41.018044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:41.018044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:41.018044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:41.018044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:41.018044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:41.018044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:41.018044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:35:41.018044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 73/143] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:41.025643 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25de64-7b4e-4ed0-b77c-d649f9984a69 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:41.162549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:41.225621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30265014-88a0-4b58-a9f8-8f1376a6a295 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:41.272647 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25de64-7b4e-4ed0-b77c-d649f9984a69 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:41.294095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cec8f-1e7b-4417-9321-cfcc6c0b16f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:41.294762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cec8f-1e7b-4417-9321-cfcc6c0b16f5 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:41.295046 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cec8f-1e7b-4417-9321-cfcc6c0b16f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:41.295315 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cec8f-1e7b-4417-9321-cfcc6c0b16f5 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:41.295989 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cec8f-1e7b-4417-9321-cfcc6c0b16f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:41.296292 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cec8f-1e7b-4417-9321-cfcc6c0b16f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:41.297710 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cec8f-1e7b-4417-9321-cfcc6c0b16f5 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:41.306966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:41.318137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 71/144] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:41.324273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cec8f-1e7b-4417-9321-cfcc6c0b16f5 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:41.340593 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48915a4b-026c-4c43-a249-98f97de5823e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:41.341221 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48915a4b-026c-4c43-a249-98f97de5823e None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:41.341513 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48915a4b-026c-4c43-a249-98f97de5823e None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:41.345343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48915a4b-026c-4c43-a249-98f97de5823e None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:41.345343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48915a4b-026c-4c43-a249-98f97de5823e None admin] RBAC: Adding query filter params (name=member) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:41.345343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48915a4b-026c-4c43-a249-98f97de5823e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:41.345343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48915a4b-026c-4c43-a249-98f97de5823e None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:41.362023 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 74/145] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:35:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:41.370503 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48915a4b-026c-4c43-a249-98f97de5823e None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:41.570282 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cec8f-1e7b-4417-9321-cfcc6c0b16f5 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:41.620798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48915a4b-026c-4c43-a249-98f97de5823e None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:41.659315 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45765c-2a13-4f84-9442-5314be9197fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:41.659972 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45765c-2a13-4f84-9442-5314be9197fa None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:41.660255 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45765c-2a13-4f84-9442-5314be9197fa None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:41.660527 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45765c-2a13-4f84-9442-5314be9197fa None admin] PATH_INFO: `/v3/users/2d2bdc2d34c34554b4a922abe3128eee` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:41.661716 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45765c-2a13-4f84-9442-5314be9197fa None admin] RBAC: Authorizing `identity:get_user(user_id=2d2bdc2d34c34554b4a922abe3128eee)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:41.663238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45765c-2a13-4f84-9442-5314be9197fa None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:41.665400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 72/146] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:41 2022] GET /identity/v3/users/2d2bdc2d34c34554b4a922abe3128eee => generated 247 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:41.676731 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45765c-2a13-4f84-9442-5314be9197fa None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:41.678305 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1aa8a-49fe-4e84-b180-35d43f2fc587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:41.678983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1aa8a-49fe-4e84-b180-35d43f2fc587 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:41.679263 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1aa8a-49fe-4e84-b180-35d43f2fc587 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:41.679535 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1aa8a-49fe-4e84-b180-35d43f2fc587 None admin] PATH_INFO: `/v3/users/f074eceaddb146fab56e8b5769451851` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:41.682618 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1aa8a-49fe-4e84-b180-35d43f2fc587 None admin] RBAC: Authorizing `identity:get_user(user_id=f074eceaddb146fab56e8b5769451851)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:41.684125 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:41.684916 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1aa8a-49fe-4e84-b180-35d43f2fc587 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:41.686725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 75/147] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:41 2022] GET /identity/v3/users/f074eceaddb146fab56e8b5769451851 => generated 275 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:41.695126 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1aa8a-49fe-4e84-b180-35d43f2fc587 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:41.765735 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:41.861700 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1aa8a-49fe-4e84-b180-35d43f2fc587 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:41.901236 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c2777-33f1-44e3-8470-8e12b4d890b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:41.901885 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c2777-33f1-44e3-8470-8e12b4d890b2 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:41.902166 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c2777-33f1-44e3-8470-8e12b4d890b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:41.902437 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c2777-33f1-44e3-8470-8e12b4d890b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:41.932595 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45765c-2a13-4f84-9442-5314be9197fa None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:41.983146 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c2777-33f1-44e3-8470-8e12b4d890b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:41.984915 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c2777-33f1-44e3-8470-8e12b4d890b2 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:42.003216 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57017c0d-5f4e-435c-ae8a-f9a75ad003ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:42.003839 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57017c0d-5f4e-435c-ae8a-f9a75ad003ec None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:42.004115 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57017c0d-5f4e-435c-ae8a-f9a75ad003ec None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:42.004385 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57017c0d-5f4e-435c-ae8a-f9a75ad003ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:42.068213 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:42.137040 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57017c0d-5f4e-435c-ae8a-f9a75ad003ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:42.138556 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57017c0d-5f4e-435c-ae8a-f9a75ad003ec None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:42.139721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 76/148] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:35:42.148516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:42.150494 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c2777-33f1-44e3-8470-8e12b4d890b2 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:42.258559 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c2777-33f1-44e3-8470-8e12b4d890b2 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:42.288425 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 73/149] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:35:42.309227 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588135c-9644-4f14-8c6e-57c763350269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:42.309872 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588135c-9644-4f14-8c6e-57c763350269 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:42.310148 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588135c-9644-4f14-8c6e-57c763350269 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:42.310419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588135c-9644-4f14-8c6e-57c763350269 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:42.311771 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588135c-9644-4f14-8c6e-57c763350269 None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:42.311997 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57017c0d-5f4e-435c-ae8a-f9a75ad003ec None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:42.313225 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588135c-9644-4f14-8c6e-57c763350269 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:42.314909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 77/150] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:42 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:42.323607 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588135c-9644-4f14-8c6e-57c763350269 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:42.353662 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:42.412666 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57017c0d-5f4e-435c-ae8a-f9a75ad003ec None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:42.430338 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:42.451422 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588135c-9644-4f14-8c6e-57c763350269 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:42.468109 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e3c67-8a2c-4035-bda1-bf6bad488b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:42.479027 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e3c67-8a2c-4035-bda1-bf6bad488b6d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:42.479360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e3c67-8a2c-4035-bda1-bf6bad488b6d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:42.479818 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e3c67-8a2c-4035-bda1-bf6bad488b6d None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:42.481392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e3c67-8a2c-4035-bda1-bf6bad488b6d None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:42.482898 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e3c67-8a2c-4035-bda1-bf6bad488b6d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:42.484568 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 74/151] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:42 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:42.485832 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53742a73-266c-4ecf-81f9-79fc8ff32974 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:42.486140 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53742a73-266c-4ecf-81f9-79fc8ff32974 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:42.486412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53742a73-266c-4ecf-81f9-79fc8ff32974 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:42.487913 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 75/152] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:42.491570 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53742a73-266c-4ecf-81f9-79fc8ff32974 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:42.498088 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afd25f-2c2f-4b3f-9a96-e6031bca8512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:42.498744 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afd25f-2c2f-4b3f-9a96-e6031bca8512 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:42.499025 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afd25f-2c2f-4b3f-9a96-e6031bca8512 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:42.499294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afd25f-2c2f-4b3f-9a96-e6031bca8512 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:42.500034 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afd25f-2c2f-4b3f-9a96-e6031bca8512 None admin] RBAC: Adding query filter params (role.id=3b2a5b7c44354447b2bcac96e039c227, scope.project.id=c120cb6ccb334c1787bda6da7e12c849, user.id=f074eceaddb146fab56e8b5769451851) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:42.500340 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afd25f-2c2f-4b3f-9a96-e6031bca8512 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:42.501804 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afd25f-2c2f-4b3f-9a96-e6031bca8512 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:42.508308 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 78/153] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:42 2022] GET /identity/v3/role_assignments?user.id=f074eceaddb146fab56e8b5769451851&scope.project.id=c120cb6ccb334c1787bda6da7e12c849&role.id=3b2a5b7c44354447b2bcac96e039c227 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:42.509750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adeb91-252d-46f6-8832-8c379850c405 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:42.510041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adeb91-252d-46f6-8832-8c379850c405 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:42.510313 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adeb91-252d-46f6-8832-8c379850c405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:42.538622 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-89adeb91-252d-46f6-8832-8c379850c405 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:42.539976 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-89adeb91-252d-46f6-8832-8c379850c405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:42.606449 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53742a73-266c-4ecf-81f9-79fc8ff32974 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:42.649357 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 79/154] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:42.675676 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adeb91-252d-46f6-8832-8c379850c405 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:42.694887 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc2b40-35c5-49ab-a7ec-0f3e0662c766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:42.695259 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:42.695577 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc2b40-35c5-49ab-a7ec-0f3e0662c766 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:42.695852 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc2b40-35c5-49ab-a7ec-0f3e0662c766 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:42.696117 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc2b40-35c5-49ab-a7ec-0f3e0662c766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:42.697563 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc2b40-35c5-49ab-a7ec-0f3e0662c766 None admin] RBAC: Adding query filter params (role.id=e62e78acab6b46f6a866b4980700caae, scope.project.id=c120cb6ccb334c1787bda6da7e12c849, user.id=2d2bdc2d34c34554b4a922abe3128eee) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:42.697873 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc2b40-35c5-49ab-a7ec-0f3e0662c766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:42.699363 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc2b40-35c5-49ab-a7ec-0f3e0662c766 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:42.711752 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 76/155] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:42 2022] GET /identity/v3/role_assignments?user.id=2d2bdc2d34c34554b4a922abe3128eee&scope.project.id=c120cb6ccb334c1787bda6da7e12c849&role.id=e62e78acab6b46f6a866b4980700caae => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:42.828283 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adeb91-252d-46f6-8832-8c379850c405 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:42.873960 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae48ca-88d7-4f92-a610-76451319d56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:42.874536 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae48ca-88d7-4f92-a610-76451319d56e None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:42.875138 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae48ca-88d7-4f92-a610-76451319d56e None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:42.875406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae48ca-88d7-4f92-a610-76451319d56e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:42.876563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae48ca-88d7-4f92-a610-76451319d56e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:42.878052 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae48ca-88d7-4f92-a610-76451319d56e None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:42.879924 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 80/156] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:35:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:42.886437 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc2b40-35c5-49ab-a7ec-0f3e0662c766 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:42.935123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:42.980629 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a7ee4-6860-4aca-b8a4-b09ecb9135c6 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:42.980952 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a7ee4-6860-4aca-b8a4-b09ecb9135c6 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:42.981176 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a7ee4-6860-4aca-b8a4-b09ecb9135c6 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:42.982575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 81/157] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:42.990790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ebc43-b44c-433b-a83f-35f5c1ca41c8 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:42.991073 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ebc43-b44c-433b-a83f-35f5c1ca41c8 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:42.991342 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ebc43-b44c-433b-a83f-35f5c1ca41c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:43.017404 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc2b40-35c5-49ab-a7ec-0f3e0662c766 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:43.017601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-8f9ebc43-b44c-433b-a83f-35f5c1ca41c8 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:43.018784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-8f9ebc43-b44c-433b-a83f-35f5c1ca41c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:43.068124 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9054d5-a767-48df-9272-296fb08e099f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:43.069038 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9054d5-a767-48df-9272-296fb08e099f None admin] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:43.070239 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9054d5-a767-48df-9272-296fb08e099f None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:43.071453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9054d5-a767-48df-9272-296fb08e099f None admin] PATH_INFO: `/v3/users` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:43.073442 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9054d5-a767-48df-9272-296fb08e099f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:43.075505 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9054d5-a767-48df-9272-296fb08e099f None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:43.124158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 77/158] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Aug 6 20:35:42 2022] POST /identity/v3/users => generated 283 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:35:43.127390 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 82/159] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:35:43.164672 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9054d5-a767-48df-9272-296fb08e099f None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:43.278610 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:43.287564 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9054d5-a767-48df-9272-296fb08e099f None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:43.328047 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9e423-c259-4b45-9792-b5059444b222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:43.328732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9e423-c259-4b45-9792-b5059444b222 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:43.329008 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9e423-c259-4b45-9792-b5059444b222 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:43.329277 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9e423-c259-4b45-9792-b5059444b222 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:43.342301 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9e423-c259-4b45-9792-b5059444b222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-59d9e423-c259-4b45-9792-b5059444b222 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:43.347653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:43.348569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:43.349356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:43.349356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:43.349356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:43.349356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:43.349356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:43.349356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:43.349356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:43.349356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:43.349356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:43.349356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:43.349356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:35:43.349356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:43.349356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 78/160] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:35:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:43.356462 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ebc43-b44c-433b-a83f-35f5c1ca41c8 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:43.367510 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:43.487102 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ebc43-b44c-433b-a83f-35f5c1ca41c8 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:43.500043 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a757-7d92-43f2-9b16-cba50703f185 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:43.500327 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a757-7d92-43f2-9b16-cba50703f185 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:43.500745 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a757-7d92-43f2-9b16-cba50703f185 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:43.504887 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 79/161] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:35:43.510551 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7cde3-b022-46a6-bcb4-67fe94b3bfaf None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:43.510860 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7cde3-b022-46a6-bcb4-67fe94b3bfaf None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:43.511130 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7cde3-b022-46a6-bcb4-67fe94b3bfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:43.535478 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-6be7cde3-b022-46a6-bcb4-67fe94b3bfaf None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:43.536757 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-6be7cde3-b022-46a6-bcb4-67fe94b3bfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:43.537433 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6816be7-9cb6-4f6c-aa6c-dd0f310cfbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:43.538064 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6816be7-9cb6-4f6c-aa6c-dd0f310cfbe3 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:43.538335 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6816be7-9cb6-4f6c-aa6c-dd0f310cfbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:43.538640 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6816be7-9cb6-4f6c-aa6c-dd0f310cfbe3 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:43.539505 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6816be7-9cb6-4f6c-aa6c-dd0f310cfbe3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:43.540724 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6816be7-9cb6-4f6c-aa6c-dd0f310cfbe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:43.542133 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6816be7-9cb6-4f6c-aa6c-dd0f310cfbe3 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:43.552260 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 83/162] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:35:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:43.557804 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6816be7-9cb6-4f6c-aa6c-dd0f310cfbe3 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:43.617417 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 80/163] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:35:43.641914 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7cde3-b022-46a6-bcb4-67fe94b3bfaf None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:43.642136 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:43.675587 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6816be7-9cb6-4f6c-aa6c-dd0f310cfbe3 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:43.722885 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f00cf-39a7-495f-b4ca-8d102e01675f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:43.723528 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f00cf-39a7-495f-b4ca-8d102e01675f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:43.723798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f00cf-39a7-495f-b4ca-8d102e01675f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:43.724061 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f00cf-39a7-495f-b4ca-8d102e01675f None admin] PATH_INFO: `/v3/users/f074eceaddb146fab56e8b5769451851` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:43.725212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f00cf-39a7-495f-b4ca-8d102e01675f None admin] RBAC: Authorizing `identity:get_user(user_id=f074eceaddb146fab56e8b5769451851)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:43.726690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f00cf-39a7-495f-b4ca-8d102e01675f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:43.728790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 84/164] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:43 2022] GET /identity/v3/users/f074eceaddb146fab56e8b5769451851 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:43.729801 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da02be-ad5a-43db-906f-4396a2f15c3d None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:43.730083 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da02be-ad5a-43db-906f-4396a2f15c3d None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:43.730351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da02be-ad5a-43db-906f-4396a2f15c3d None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:43.737476 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 85/165] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:43.739146 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b46ef-fecd-475a-8cdf-0bb42f2dbaae None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:43.739709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b46ef-fecd-475a-8cdf-0bb42f2dbaae None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:43.739987 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b46ef-fecd-475a-8cdf-0bb42f2dbaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:43.755315 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:43.768513 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-e76b46ef-fecd-475a-8cdf-0bb42f2dbaae None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:43.769687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-e76b46ef-fecd-475a-8cdf-0bb42f2dbaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:43.780377 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7cde3-b022-46a6-bcb4-67fe94b3bfaf None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:43.828926 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a6c90-6766-4214-b725-88be6a7c5624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:43.829606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a6c90-6766-4214-b725-88be6a7c5624 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:43.830097 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a6c90-6766-4214-b725-88be6a7c5624 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:43.830199 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a6c90-6766-4214-b725-88be6a7c5624 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:43.841999 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a6c90-6766-4214-b725-88be6a7c5624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-e65a6c90-6766-4214-b725-88be6a7c5624 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:43.847251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:43.848098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:43.849068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:43.849068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:43.849068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:43.849068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:43.849068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:43.849068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:43.849068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:43.849068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:43.849068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:43.849068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:43.849068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:43.849068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:43.849068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 81/166] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:43.854462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a6c90-6766-4214-b725-88be6a7c5624 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:43.865397 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 86/167] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:43.866638 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b46ef-fecd-475a-8cdf-0bb42f2dbaae None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:43.953783 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:43.981883 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a6c90-6766-4214-b725-88be6a7c5624 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:43.989564 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b46ef-fecd-475a-8cdf-0bb42f2dbaae None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:44.030610 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6150361-a7b3-457e-9ac6-6f0ec785cc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:44.030610 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6150361-a7b3-457e-9ac6-6f0ec785cc15 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:44.030610 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6150361-a7b3-457e-9ac6-6f0ec785cc15 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:44.030610 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6150361-a7b3-457e-9ac6-6f0ec785cc15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:44.037875 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc1d89-dc9d-4eba-94b6-afbd5777213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:44.038611 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc1d89-dc9d-4eba-94b6-afbd5777213e None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:44.038885 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc1d89-dc9d-4eba-94b6-afbd5777213e None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:44.039148 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc1d89-dc9d-4eba-94b6-afbd5777213e None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:44.043285 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc1d89-dc9d-4eba-94b6-afbd5777213e None admin] RBAC: Adding query filter params (name=member) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:44.043676 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc1d89-dc9d-4eba-94b6-afbd5777213e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:44.045374 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc1d89-dc9d-4eba-94b6-afbd5777213e None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:44.054712 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:44.060717 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 87/168] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:35:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:44.064606 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc1d89-dc9d-4eba-94b6-afbd5777213e None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:44.152041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6150361-a7b3-457e-9ac6-6f0ec785cc15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:44.153547 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6150361-a7b3-457e-9ac6-6f0ec785cc15 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:44.278780 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc1d89-dc9d-4eba-94b6-afbd5777213e None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:44.313086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:44.321186 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0bfb5-671f-4b59-a8ba-03665426ab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:44.324008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0bfb5-671f-4b59-a8ba-03665426ab42 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:44.325441 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0bfb5-671f-4b59-a8ba-03665426ab42 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:44.325731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0bfb5-671f-4b59-a8ba-03665426ab42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:44.335271 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 82/169] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:35:44.336204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6150361-a7b3-457e-9ac6-6f0ec785cc15 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:44.350916 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0bfb5-671f-4b59-a8ba-03665426ab42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-76b0bfb5-671f-4b59-a8ba-03665426ab42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:44.358208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:44.359105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:44.359947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:44.359947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:44.359947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:44.359947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:44.359947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:44.359947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:44.359947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:44.359947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:44.359947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:44.359947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:44.359947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:35:44.359947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:35:44.362040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 88/170] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:44.363459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0bfb5-671f-4b59-a8ba-03665426ab42 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:44.394621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:44.488957 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6150361-a7b3-457e-9ac6-6f0ec785cc15 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:44.522982 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6cb19-2c58-42cd-9271-129c376ef47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:44.523617 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6cb19-2c58-42cd-9271-129c376ef47b None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:44.523893 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6cb19-2c58-42cd-9271-129c376ef47b None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:44.524160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6cb19-2c58-42cd-9271-129c376ef47b None admin] PATH_INFO: `/v3/users/f074eceaddb146fab56e8b5769451851` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:44.525352 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6cb19-2c58-42cd-9271-129c376ef47b None admin] RBAC: Authorizing `identity:get_user(user_id=f074eceaddb146fab56e8b5769451851)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:44.530667 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6cb19-2c58-42cd-9271-129c376ef47b None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:44.530667 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 83/171] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:44 2022] GET /identity/v3/users/f074eceaddb146fab56e8b5769451851 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:44.530667 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6cb19-2c58-42cd-9271-129c376ef47b None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:44.589369 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0bfb5-671f-4b59-a8ba-03665426ab42 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:44.629737 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a618464-8543-4fbf-ac68-71ff83c87499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:44.630375 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a618464-8543-4fbf-ac68-71ff83c87499 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:44.630685 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a618464-8543-4fbf-ac68-71ff83c87499 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:44.630958 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a618464-8543-4fbf-ac68-71ff83c87499 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:44.632628 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a618464-8543-4fbf-ac68-71ff83c87499 None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:44.634474 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a618464-8543-4fbf-ac68-71ff83c87499 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:44.636726 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 89/172] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:44 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:44.637530 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a618464-8543-4fbf-ac68-71ff83c87499 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:44.684626 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6cb19-2c58-42cd-9271-129c376ef47b None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:44.708248 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:44.724681 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59349f-a84a-4b6b-ac5d-c5ce1dc510f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:44.725616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59349f-a84a-4b6b-ac5d-c5ce1dc510f5 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:44.726084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59349f-a84a-4b6b-ac5d-c5ce1dc510f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:44.726535 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59349f-a84a-4b6b-ac5d-c5ce1dc510f5 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:44.727409 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59349f-a84a-4b6b-ac5d-c5ce1dc510f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:44.728174 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59349f-a84a-4b6b-ac5d-c5ce1dc510f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:44.729821 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59349f-a84a-4b6b-ac5d-c5ce1dc510f5 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:44.739005 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 84/173] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:35:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:44.740175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59349f-a84a-4b6b-ac5d-c5ce1dc510f5 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:44.799716 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:44.847913 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59349f-a84a-4b6b-ac5d-c5ce1dc510f5 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:44.883200 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaa1bd-fcd8-4015-af37-b34cc5a7da18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:44.884170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaa1bd-fcd8-4015-af37-b34cc5a7da18 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:44.884650 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaa1bd-fcd8-4015-af37-b34cc5a7da18 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:44.885104 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaa1bd-fcd8-4015-af37-b34cc5a7da18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:44.886018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facaa1bd-fcd8-4015-af37-b34cc5a7da18 None admin] RBAC: Adding query filter params (role.id=273b4b42102c497baaeced73ebb2ba7f, scope.project.id=c120cb6ccb334c1787bda6da7e12c849, user.id=f074eceaddb146fab56e8b5769451851) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:44.886529 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facaa1bd-fcd8-4015-af37-b34cc5a7da18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:44.888193 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facaa1bd-fcd8-4015-af37-b34cc5a7da18 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:44.894659 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 85/174] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:44 2022] GET /identity/v3/role_assignments?user.id=f074eceaddb146fab56e8b5769451851&scope.project.id=c120cb6ccb334c1787bda6da7e12c849&role.id=273b4b42102c497baaeced73ebb2ba7f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:44.895681 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaa1bd-fcd8-4015-af37-b34cc5a7da18 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:44.905747 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a618464-8543-4fbf-ac68-71ff83c87499 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:44.934197 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:44.988484 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e3d40-510d-4038-b230-c3cdc0c6f423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:44.989134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e3d40-510d-4038-b230-c3cdc0c6f423 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:44.989425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e3d40-510d-4038-b230-c3cdc0c6f423 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:44.989684 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e3d40-510d-4038-b230-c3cdc0c6f423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:45.007920 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaa1bd-fcd8-4015-af37-b34cc5a7da18 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:45.046018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700083f5-6275-4aee-81db-71ce14599c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:45.047106 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700083f5-6275-4aee-81db-71ce14599c9e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:45.047629 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700083f5-6275-4aee-81db-71ce14599c9e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:45.048187 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700083f5-6275-4aee-81db-71ce14599c9e None admin] PATH_INFO: `/v3/users/ac471b75500c41498bd52e22c4fa0555` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:45.049826 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700083f5-6275-4aee-81db-71ce14599c9e None admin] RBAC: Authorizing `identity:get_user(user_id=ac471b75500c41498bd52e22c4fa0555)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:45.051582 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700083f5-6275-4aee-81db-71ce14599c9e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:45.053599 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 86/175] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:44 2022] GET /identity/v3/users/ac471b75500c41498bd52e22c4fa0555 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:45.061508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700083f5-6275-4aee-81db-71ce14599c9e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:45.181899 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e3d40-510d-4038-b230-c3cdc0c6f423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:45.183435 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e3d40-510d-4038-b230-c3cdc0c6f423 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:45.229021 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700083f5-6275-4aee-81db-71ce14599c9e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:45.232367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:45.276425 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9490a-77c2-40d1-9109-495ef59d5b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:45.277376 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9490a-77c2-40d1-9109-495ef59d5b2e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:45.277819 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9490a-77c2-40d1-9109-495ef59d5b2e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:45.278223 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9490a-77c2-40d1-9109-495ef59d5b2e None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:45.279657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9490a-77c2-40d1-9109-495ef59d5b2e None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:45.282273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9490a-77c2-40d1-9109-495ef59d5b2e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:45.284904 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 87/176] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:45 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:45.292502 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9490a-77c2-40d1-9109-495ef59d5b2e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:45.310180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:45.399472 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 90/177] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:35:45.400993 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e3d40-510d-4038-b230-c3cdc0c6f423 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:45.504593 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9490a-77c2-40d1-9109-495ef59d5b2e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:45.571057 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b246f-b817-4dca-b225-491805a653b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:45.573406 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b246f-b817-4dca-b225-491805a653b6 None admin] REQUEST_METHOD: `PUT` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:45.574057 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b246f-b817-4dca-b225-491805a653b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:45.575188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b246f-b817-4dca-b225-491805a653b6 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849/users/ac471b75500c41498bd52e22c4fa0555/roles/895af4bcf7524c659872539f2eb1eebe` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:45.578154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b246f-b817-4dca-b225-491805a653b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c120cb6ccb334c1787bda6da7e12c849, user_id=ac471b75500c41498bd52e22c4fa0555, role_id=895af4bcf7524c659872539f2eb1eebe)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:45.580004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b246f-b817-4dca-b225-491805a653b6 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:45.608297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 88/178] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:35:45 2022] PUT /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849/users/ac471b75500c41498bd52e22c4fa0555/roles/895af4bcf7524c659872539f2eb1eebe => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:35:45.617359 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e3d40-510d-4038-b230-c3cdc0c6f423 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:45.661455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033eee2-5cfd-4bb0-ae0e-1cfc4ea1cf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:45.662391 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033eee2-5cfd-4bb0-ae0e-1cfc4ea1cf60 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:45.662833 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033eee2-5cfd-4bb0-ae0e-1cfc4ea1cf60 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:45.663243 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033eee2-5cfd-4bb0-ae0e-1cfc4ea1cf60 None admin] PATH_INFO: `/v3/projects/7c483e3f3be1480996781758a7afc82c` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:45.664679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033eee2-5cfd-4bb0-ae0e-1cfc4ea1cf60 None admin] RBAC: Authorizing `identity:get_project(project_id=7c483e3f3be1480996781758a7afc82c)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:45.666370 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033eee2-5cfd-4bb0-ae0e-1cfc4ea1cf60 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:45.668255 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 91/179] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:45 2022] GET /identity/v3/projects/7c483e3f3be1480996781758a7afc82c => generated 312 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:45.675017 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b246f-b817-4dca-b225-491805a653b6 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:45.710545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:45.786488 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b246f-b817-4dca-b225-491805a653b6 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:45.823320 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3597a41-2d58-454a-acbe-bae2f5324ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:45.823860 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3597a41-2d58-454a-acbe-bae2f5324ddb None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:45.824132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3597a41-2d58-454a-acbe-bae2f5324ddb None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:45.824400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3597a41-2d58-454a-acbe-bae2f5324ddb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:45.825140 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3597a41-2d58-454a-acbe-bae2f5324ddb None admin] RBAC: Adding query filter params (role.id=3b2a5b7c44354447b2bcac96e039c227, scope.project.id=7c483e3f3be1480996781758a7afc82c, user.id=f074eceaddb146fab56e8b5769451851) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:45.825445 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3597a41-2d58-454a-acbe-bae2f5324ddb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:45.826999 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3597a41-2d58-454a-acbe-bae2f5324ddb None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:45.833890 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 89/180] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:45 2022] GET /identity/v3/role_assignments?user.id=f074eceaddb146fab56e8b5769451851&scope.project.id=7c483e3f3be1480996781758a7afc82c&role.id=3b2a5b7c44354447b2bcac96e039c227 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:46.186650 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64baa5-10d4-4538-937c-17c8d8743d2c None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:46.187135 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64baa5-10d4-4538-937c-17c8d8743d2c None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:46.187135 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64baa5-10d4-4538-937c-17c8d8743d2c None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:46.188726 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 92/181] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:46.194205 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011ad74-5cc5-49f3-80e8-4e3a96fd0df2 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:46.194491 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011ad74-5cc5-49f3-80e8-4e3a96fd0df2 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:46.194788 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011ad74-5cc5-49f3-80e8-4e3a96fd0df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:46.223718 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-e011ad74-5cc5-49f3-80e8-4e3a96fd0df2 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:46.225269 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-e011ad74-5cc5-49f3-80e8-4e3a96fd0df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:46.268119 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba9d8b-cb2a-40e8-9c04-5190095e8a53 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:46.268758 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba9d8b-cb2a-40e8-9c04-5190095e8a53 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:46.269227 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba9d8b-cb2a-40e8-9c04-5190095e8a53 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:46.271994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 93/182] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:35:46.278136 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68203706-7476-4f43-b6e8-81a3ba7f1df3 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:46.278418 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68203706-7476-4f43-b6e8-81a3ba7f1df3 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:46.278754 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68203706-7476-4f43-b6e8-81a3ba7f1df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:46.307785 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-68203706-7476-4f43-b6e8-81a3ba7f1df3 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:46.308278 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-68203706-7476-4f43-b6e8-81a3ba7f1df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:46.330406 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 90/183] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:46.353463 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:46.375925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011ad74-5cc5-49f3-80e8-4e3a96fd0df2 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:46.406133 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 94/184] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:35:46.413336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:46.431012 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68203706-7476-4f43-b6e8-81a3ba7f1df3 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:46.508020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011ad74-5cc5-49f3-80e8-4e3a96fd0df2 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:46.543389 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1998a-be57-44d6-a2d0-81f4e811c212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:46.544025 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1998a-be57-44d6-a2d0-81f4e811c212 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:46.544304 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1998a-be57-44d6-a2d0-81f4e811c212 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:46.544574 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1998a-be57-44d6-a2d0-81f4e811c212 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:46.544677 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68203706-7476-4f43-b6e8-81a3ba7f1df3 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:46.555033 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1998a-be57-44d6-a2d0-81f4e811c212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-fab1998a-be57-44d6-a2d0-81f4e811c212 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:46.560000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:46.560861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:46.561623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:46.561623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:46.561623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:46.561623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:46.561623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:46.561623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:46.561623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:46.561623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:46.561623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:46.561623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:46.561623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:46.561623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:46.561623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 91/185] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:35:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:35:46.562740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9205e-b715-4d28-ac1f-81bd3f039189 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:46.562956 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9205e-b715-4d28-ac1f-81bd3f039189 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:46.563224 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9205e-b715-4d28-ac1f-81bd3f039189 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:46.566633 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 92/186] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:46.567869 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9205e-b715-4d28-ac1f-81bd3f039189 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:46.587129 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263bb2d-a71e-4d85-9c71-91ab4ff90813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:46.588001 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263bb2d-a71e-4d85-9c71-91ab4ff90813 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:46.588330 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263bb2d-a71e-4d85-9c71-91ab4ff90813 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:46.588598 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263bb2d-a71e-4d85-9c71-91ab4ff90813 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:46.599818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263bb2d-a71e-4d85-9c71-91ab4ff90813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-c263bb2d-a71e-4d85-9c71-91ab4ff90813 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:46.604617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:46.605455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:46.606245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:46.606245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:46.606245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:46.606245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:46.606245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:46.606245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:46.606245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:46.606245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:46.606245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:46.606245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:46.606245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:35:46.606245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:35:46.606245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 95/187] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:35:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:35:46.606935 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b14bd-f7ce-4862-ab11-7fbfc8ce245f None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:46.607555 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b14bd-f7ce-4862-ab11-7fbfc8ce245f None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:46.607555 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b14bd-f7ce-4862-ab11-7fbfc8ce245f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:46.625578 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-ba4b14bd-f7ce-4862-ab11-7fbfc8ce245f None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:46.626773 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-ba4b14bd-f7ce-4862-ab11-7fbfc8ce245f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:46.640556 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:46.664154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:46.681171 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9205e-b715-4d28-ac1f-81bd3f039189 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:46.707028 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 96/188] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:46.708475 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b14bd-f7ce-4862-ab11-7fbfc8ce245f None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:46.823917 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b14bd-f7ce-4862-ab11-7fbfc8ce245f None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:46.840436 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6a5da-62dc-418d-bc85-c59b1bf27b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:46.841038 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6a5da-62dc-418d-bc85-c59b1bf27b1a None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:46.841304 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6a5da-62dc-418d-bc85-c59b1bf27b1a None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:46.841583 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6a5da-62dc-418d-bc85-c59b1bf27b1a None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:46.842231 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6a5da-62dc-418d-bc85-c59b1bf27b1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:46.842653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6a5da-62dc-418d-bc85-c59b1bf27b1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:46.843953 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6a5da-62dc-418d-bc85-c59b1bf27b1a None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:46.852528 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 93/189] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:46.853332 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6a5da-62dc-418d-bc85-c59b1bf27b1a None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:46.865810 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289efb61-6a59-46e6-8935-3c8101897ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:46.866440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289efb61-6a59-46e6-8935-3c8101897ca4 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:46.866884 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289efb61-6a59-46e6-8935-3c8101897ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:46.867157 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289efb61-6a59-46e6-8935-3c8101897ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:46.867831 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289efb61-6a59-46e6-8935-3c8101897ca4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:46.868711 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289efb61-6a59-46e6-8935-3c8101897ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:46.870080 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289efb61-6a59-46e6-8935-3c8101897ca4 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:46.878192 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 97/190] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:35:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:46.878192 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289efb61-6a59-46e6-8935-3c8101897ca4 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:46.891730 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:46.967216 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6a5da-62dc-418d-bc85-c59b1bf27b1a None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:46.980350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289efb61-6a59-46e6-8935-3c8101897ca4 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:47.003142 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77579b4-ab04-4a0b-8b2b-9b65f7a529de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:47.004073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77579b4-ab04-4a0b-8b2b-9b65f7a529de None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:47.004491 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77579b4-ab04-4a0b-8b2b-9b65f7a529de None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:47.004901 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77579b4-ab04-4a0b-8b2b-9b65f7a529de None admin] PATH_INFO: `/v3/domains/default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:47.006354 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77579b4-ab04-4a0b-8b2b-9b65f7a529de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:47.007966 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77579b4-ab04-4a0b-8b2b-9b65f7a529de None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:47.010086 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 94/191] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:35:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:47.010876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77579b4-ab04-4a0b-8b2b-9b65f7a529de None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:47.019520 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d62e0-3534-4b08-8ea3-3119c98f17ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:47.020162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d62e0-3534-4b08-8ea3-3119c98f17ea None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:47.020411 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d62e0-3534-4b08-8ea3-3119c98f17ea None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:47.020705 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d62e0-3534-4b08-8ea3-3119c98f17ea None admin] PATH_INFO: `/v3/users/c10942df74ab44d2a808533c0955504f` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:47.032042 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:47.039201 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d62e0-3534-4b08-8ea3-3119c98f17ea None admin] RBAC: Authorizing `identity:get_user(user_id=c10942df74ab44d2a808533c0955504f)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:47.041441 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d62e0-3534-4b08-8ea3-3119c98f17ea None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:47.043970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 98/192] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:46 2022] GET /identity/v3/users/c10942df74ab44d2a808533c0955504f => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:47.044561 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d62e0-3534-4b08-8ea3-3119c98f17ea None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:47.118888 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77579b4-ab04-4a0b-8b2b-9b65f7a529de None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:47.137673 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:47.153179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f430b3-1297-4d29-b2fb-e19a8eadc122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:47.154351 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f430b3-1297-4d29-b2fb-e19a8eadc122 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:47.154851 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f430b3-1297-4d29-b2fb-e19a8eadc122 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:47.155125 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f430b3-1297-4d29-b2fb-e19a8eadc122 None admin] PATH_INFO: `/v3/users/c10942df74ab44d2a808533c0955504f` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:47.156280 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f430b3-1297-4d29-b2fb-e19a8eadc122 None admin] RBAC: Authorizing `identity:get_user(user_id=c10942df74ab44d2a808533c0955504f)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:47.157737 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f430b3-1297-4d29-b2fb-e19a8eadc122 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:47.159365 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 95/193] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:47 2022] GET /identity/v3/users/c10942df74ab44d2a808533c0955504f => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:47.160134 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f430b3-1297-4d29-b2fb-e19a8eadc122 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:47.180413 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d62e0-3534-4b08-8ea3-3119c98f17ea None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:47.217119 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec04ed-ec4a-49d8-b0a9-b2e6ebdd5b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:47.217749 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec04ed-ec4a-49d8-b0a9-b2e6ebdd5b88 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:47.217976 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec04ed-ec4a-49d8-b0a9-b2e6ebdd5b88 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:47.218352 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec04ed-ec4a-49d8-b0a9-b2e6ebdd5b88 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:47.219129 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec04ed-ec4a-49d8-b0a9-b2e6ebdd5b88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:47.220915 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec04ed-ec4a-49d8-b0a9-b2e6ebdd5b88 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:47.246042 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 99/194] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Aug 6 20:35:47 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:35:47.247047 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec04ed-ec4a-49d8-b0a9-b2e6ebdd5b88 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:47.256344 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:47.283101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f430b3-1297-4d29-b2fb-e19a8eadc122 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:47.344237 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370118c7-cea1-4acf-bc6d-a51d59e146c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:47.345502 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370118c7-cea1-4acf-bc6d-a51d59e146c3 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:47.345908 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370118c7-cea1-4acf-bc6d-a51d59e146c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:47.346343 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370118c7-cea1-4acf-bc6d-a51d59e146c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:47.389446 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec04ed-ec4a-49d8-b0a9-b2e6ebdd5b88 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:47.421724 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:47.423894 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370118c7-cea1-4acf-bc6d-a51d59e146c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:47.425619 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370118c7-cea1-4acf-bc6d-a51d59e146c3 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:47.437926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53122361-5c91-4af8-a912-4f1d7abedafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:47.438775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53122361-5c91-4af8-a912-4f1d7abedafc None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:47.439152 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53122361-5c91-4af8-a912-4f1d7abedafc None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:47.439518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53122361-5c91-4af8-a912-4f1d7abedafc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:47.522323 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53122361-5c91-4af8-a912-4f1d7abedafc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:47.523791 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53122361-5c91-4af8-a912-4f1d7abedafc None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:47.540888 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:47.563955 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 96/195] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:35:47.569359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370118c7-cea1-4acf-bc6d-a51d59e146c3 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:47.670632 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 100/196] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:35:47.676551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53122361-5c91-4af8-a912-4f1d7abedafc None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:47.705522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370118c7-cea1-4acf-bc6d-a51d59e146c3 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:47.707036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:47.750612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8395e56-68aa-4060-b76d-02f73c264325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:47.751253 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8395e56-68aa-4060-b76d-02f73c264325 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:47.751520 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8395e56-68aa-4060-b76d-02f73c264325 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:47.751780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8395e56-68aa-4060-b76d-02f73c264325 None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:47.752892 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8395e56-68aa-4060-b76d-02f73c264325 None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:47.754328 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8395e56-68aa-4060-b76d-02f73c264325 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:47.756166 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 97/197] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:47 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:47.762987 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8395e56-68aa-4060-b76d-02f73c264325 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:47.835946 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53122361-5c91-4af8-a912-4f1d7abedafc None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:47.850843 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:47.911291 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea622cd-2730-498a-a4dc-80dfb50a1894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:47.911994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea622cd-2730-498a-a4dc-80dfb50a1894 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:47.912264 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea622cd-2730-498a-a4dc-80dfb50a1894 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:47.912523 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea622cd-2730-498a-a4dc-80dfb50a1894 None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:47.913733 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea622cd-2730-498a-a4dc-80dfb50a1894 None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:47.915262 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea622cd-2730-498a-a4dc-80dfb50a1894 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:47.918692 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 101/198] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:47 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:47.924032 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea622cd-2730-498a-a4dc-80dfb50a1894 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:47.933771 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8395e56-68aa-4060-b76d-02f73c264325 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:48.027335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eaefd-b0a3-46fb-9c09-d7d5e880f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:48.027963 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eaefd-b0a3-46fb-9c09-d7d5e880f879 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:48.028239 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eaefd-b0a3-46fb-9c09-d7d5e880f879 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:48.028510 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eaefd-b0a3-46fb-9c09-d7d5e880f879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:48.029253 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eaefd-b0a3-46fb-9c09-d7d5e880f879 None admin] RBAC: Adding query filter params (role.id=e62e78acab6b46f6a866b4980700caae, scope.project.id=dc297353000a4a698d3362cde7e2f1bf, user.id=c10942df74ab44d2a808533c0955504f) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:48.029558 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eaefd-b0a3-46fb-9c09-d7d5e880f879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:48.029807 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:48.031045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eaefd-b0a3-46fb-9c09-d7d5e880f879 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:48.036995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 98/199] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:47 2022] GET /identity/v3/role_assignments?user.id=c10942df74ab44d2a808533c0955504f&scope.project.id=dc297353000a4a698d3362cde7e2f1bf&role.id=e62e78acab6b46f6a866b4980700caae => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:48.039654 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea622cd-2730-498a-a4dc-80dfb50a1894 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:48.081654 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073f5fc-2137-427d-9db4-02159b6e5ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:48.082317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073f5fc-2137-427d-9db4-02159b6e5ad9 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:48.082618 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073f5fc-2137-427d-9db4-02159b6e5ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:48.082880 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073f5fc-2137-427d-9db4-02159b6e5ad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:48.083687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073f5fc-2137-427d-9db4-02159b6e5ad9 None admin] RBAC: Adding query filter params (role.id=273b4b42102c497baaeced73ebb2ba7f, scope.project.id=dc297353000a4a698d3362cde7e2f1bf, user.id=c10942df74ab44d2a808533c0955504f) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:48.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073f5fc-2137-427d-9db4-02159b6e5ad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:48.085524 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073f5fc-2137-427d-9db4-02159b6e5ad9 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:48.092858 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 102/200] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:47 2022] GET /identity/v3/role_assignments?user.id=c10942df74ab44d2a808533c0955504f&scope.project.id=dc297353000a4a698d3362cde7e2f1bf&role.id=273b4b42102c497baaeced73ebb2ba7f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:48.366975 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee49c0f-d734-4b4a-aa58-48195c04b267 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:48.367384 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee49c0f-d734-4b4a-aa58-48195c04b267 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:48.367556 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee49c0f-d734-4b4a-aa58-48195c04b267 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:48.369129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 99/201] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:48.374833 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885002b-a6ea-4e8d-b6af-fffc529559a4 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:48.375320 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885002b-a6ea-4e8d-b6af-fffc529559a4 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:48.375420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885002b-a6ea-4e8d-b6af-fffc529559a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:48.400213 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-1885002b-a6ea-4e8d-b6af-fffc529559a4 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:48.401408 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-1885002b-a6ea-4e8d-b6af-fffc529559a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:48.483752 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 103/202] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:48.507829 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee49c0f-d734-4b4a-aa58-48195c04b267 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:48.613691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee49c0f-d734-4b4a-aa58-48195c04b267 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:48.630802 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:48.655506 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f70bcc-470f-454e-9f95-c5830cbaa621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:48.656152 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f70bcc-470f-454e-9f95-c5830cbaa621 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:48.656428 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f70bcc-470f-454e-9f95-c5830cbaa621 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:48.656697 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f70bcc-470f-454e-9f95-c5830cbaa621 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:48.667570 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f70bcc-470f-454e-9f95-c5830cbaa621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-b2f70bcc-470f-454e-9f95-c5830cbaa621 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:48.672490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:48.673335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:48.674077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:48.674077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:48.674077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:48.674077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:48.674077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:48.674077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:48.674077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:48.674077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:48.674077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:48.674077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:48.674077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:35:48.674077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:48.674077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 100/203] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:48.679574 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885002b-a6ea-4e8d-b6af-fffc529559a4 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:48.777557 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:48.792906 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885002b-a6ea-4e8d-b6af-fffc529559a4 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:48.829082 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf72acb-22b6-4bc6-bfb8-1fef3649a649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:48.829700 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf72acb-22b6-4bc6-bfb8-1fef3649a649 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:48.829974 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf72acb-22b6-4bc6-bfb8-1fef3649a649 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:48.830242 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf72acb-22b6-4bc6-bfb8-1fef3649a649 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:48.830933 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf72acb-22b6-4bc6-bfb8-1fef3649a649 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:48.831231 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf72acb-22b6-4bc6-bfb8-1fef3649a649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:48.832607 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf72acb-22b6-4bc6-bfb8-1fef3649a649 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:48.841508 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 104/204] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:35:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:48.847514 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f70bcc-470f-454e-9f95-c5830cbaa621 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:48.950412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f70bcc-470f-454e-9f95-c5830cbaa621 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:48.984140 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a99e8-5550-4c1e-a61f-de0ede996579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:48.984777 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a99e8-5550-4c1e-a61f-de0ede996579 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:48.985051 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a99e8-5550-4c1e-a61f-de0ede996579 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:48.985317 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a99e8-5550-4c1e-a61f-de0ede996579 None admin] PATH_INFO: `/v3/users/ac471b75500c41498bd52e22c4fa0555` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:48.986440 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a99e8-5550-4c1e-a61f-de0ede996579 None admin] RBAC: Authorizing `identity:get_user(user_id=ac471b75500c41498bd52e22c4fa0555)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:48.987912 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a99e8-5550-4c1e-a61f-de0ede996579 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:48.989487 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 101/205] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:48 2022] GET /identity/v3/users/ac471b75500c41498bd52e22c4fa0555 => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:48.995381 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf72acb-22b6-4bc6-bfb8-1fef3649a649 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:49.124508 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf72acb-22b6-4bc6-bfb8-1fef3649a649 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:49.169578 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4ee92-d46d-4076-b0c4-c13b1b41d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:49.170603 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4ee92-d46d-4076-b0c4-c13b1b41d80c None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:49.171098 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4ee92-d46d-4076-b0c4-c13b1b41d80c None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:49.171569 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4ee92-d46d-4076-b0c4-c13b1b41d80c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:49.190943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:49.260809 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4ee92-d46d-4076-b0c4-c13b1b41d80c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:49.262327 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4ee92-d46d-4076-b0c4-c13b1b41d80c None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:49.364324 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 105/206] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:35:49.370092 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a99e8-5550-4c1e-a61f-de0ede996579 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:49.418102 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:49.474272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a99e8-5550-4c1e-a61f-de0ede996579 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:49.508918 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05c0f5-172a-4008-b836-b7061d23f7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:49.509748 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05c0f5-172a-4008-b836-b7061d23f7e0 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:49.510054 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05c0f5-172a-4008-b836-b7061d23f7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:49.510329 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05c0f5-172a-4008-b836-b7061d23f7e0 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:49.511616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05c0f5-172a-4008-b836-b7061d23f7e0 None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:49.513076 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05c0f5-172a-4008-b836-b7061d23f7e0 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:49.514773 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 102/207] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:49 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:49.520967 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4ee92-d46d-4076-b0c4-c13b1b41d80c None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:49.569502 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:49.632036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4ee92-d46d-4076-b0c4-c13b1b41d80c None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:49.676616 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40eb42-8eb1-498e-b130-a3d8e867f154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:49.677235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40eb42-8eb1-498e-b130-a3d8e867f154 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:49.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40eb42-8eb1-498e-b130-a3d8e867f154 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:49.677775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40eb42-8eb1-498e-b130-a3d8e867f154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:49.678504 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40eb42-8eb1-498e-b130-a3d8e867f154 None admin] RBAC: Adding query filter params (role.id=895af4bcf7524c659872539f2eb1eebe, scope.project.id=c120cb6ccb334c1787bda6da7e12c849, user.id=ac471b75500c41498bd52e22c4fa0555) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:49.678833 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40eb42-8eb1-498e-b130-a3d8e867f154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:49.680271 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40eb42-8eb1-498e-b130-a3d8e867f154 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:49.686883 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 106/208] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:49 2022] GET /identity/v3/role_assignments?user.id=ac471b75500c41498bd52e22c4fa0555&scope.project.id=c120cb6ccb334c1787bda6da7e12c849&role.id=895af4bcf7524c659872539f2eb1eebe => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:50.090690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f2f35-b80d-4681-a76d-807f7b2c7a92 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:50.091204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f2f35-b80d-4681-a76d-807f7b2c7a92 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:50.091204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f2f35-b80d-4681-a76d-807f7b2c7a92 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:50.092822 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 103/209] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:50.098309 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda43ba-79f3-4013-9e19-05963a3e0d16 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:50.098615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda43ba-79f3-4013-9e19-05963a3e0d16 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:50.098887 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda43ba-79f3-4013-9e19-05963a3e0d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:50.123199 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-7eda43ba-79f3-4013-9e19-05963a3e0d16 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:50.124706 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-7eda43ba-79f3-4013-9e19-05963a3e0d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:50.212133 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 107/210] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:35:50.237139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f2f35-b80d-4681-a76d-807f7b2c7a92 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:50.342578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f2f35-b80d-4681-a76d-807f7b2c7a92 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:50.358131 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:50.366927 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615b6f6-7289-4381-96c5-1f1b646f8359 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:50.367518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615b6f6-7289-4381-96c5-1f1b646f8359 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:50.368383 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615b6f6-7289-4381-96c5-1f1b646f8359 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:50.369990 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 108/211] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:35:50.376376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198349-c466-43ea-ac5f-c79a86132525 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:50.376654 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198349-c466-43ea-ac5f-c79a86132525 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:50.376922 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198349-c466-43ea-ac5f-c79a86132525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:50.388885 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a30832-023e-422e-afd3-97775e894de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:50.389967 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a30832-023e-422e-afd3-97775e894de9 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:50.390377 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a30832-023e-422e-afd3-97775e894de9 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:50.390804 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a30832-023e-422e-afd3-97775e894de9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:50.397315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-ad198349-c466-43ea-ac5f-c79a86132525 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:50.398921 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-ad198349-c466-43ea-ac5f-c79a86132525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:50.402424 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a30832-023e-422e-afd3-97775e894de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-c2a30832-023e-422e-afd3-97775e894de9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:50.407591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:50.408459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:50.409204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:50.409204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:50.409204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:50.409204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:50.409204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:50.409204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:50.409204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:50.409204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:50.409204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:50.409204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:50.409204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:50.409204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:50.409787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 104/212] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:50.416945 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a30832-023e-422e-afd3-97775e894de9 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:50.443725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:50.502696 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 109/213] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:35:50.521653 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad198349-c466-43ea-ac5f-c79a86132525 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:50.529840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a30832-023e-422e-afd3-97775e894de9 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:50.570288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42ed67-7a9f-4fe4-8077-5eb1f2787c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:50.570925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42ed67-7a9f-4fe4-8077-5eb1f2787c02 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:50.571528 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42ed67-7a9f-4fe4-8077-5eb1f2787c02 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:50.571887 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42ed67-7a9f-4fe4-8077-5eb1f2787c02 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:50.572463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42ed67-7a9f-4fe4-8077-5eb1f2787c02 None admin] RBAC: Adding query filter params (name=member) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:50.572762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42ed67-7a9f-4fe4-8077-5eb1f2787c02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:50.574156 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42ed67-7a9f-4fe4-8077-5eb1f2787c02 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:50.583442 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 105/214] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:35:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:50.590154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42ed67-7a9f-4fe4-8077-5eb1f2787c02 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:50.626809 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:50.644270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad198349-c466-43ea-ac5f-c79a86132525 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:50.683057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30cf50-1e76-441f-a0b7-0573030ec152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:50.683701 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30cf50-1e76-441f-a0b7-0573030ec152 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:50.683970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30cf50-1e76-441f-a0b7-0573030ec152 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:50.684237 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30cf50-1e76-441f-a0b7-0573030ec152 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:50.685402 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30cf50-1e76-441f-a0b7-0573030ec152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:50.686870 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30cf50-1e76-441f-a0b7-0573030ec152 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:50.688961 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 110/215] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:35:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:50.694509 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30cf50-1e76-441f-a0b7-0573030ec152 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:50.698109 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42ed67-7a9f-4fe4-8077-5eb1f2787c02 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:50.733878 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66f6ba-14af-40f0-a008-db39859a60f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:50.734951 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66f6ba-14af-40f0-a008-db39859a60f3 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:50.735417 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66f6ba-14af-40f0-a008-db39859a60f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:50.735886 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66f6ba-14af-40f0-a008-db39859a60f3 None admin] PATH_INFO: `/v3/users/91e6f13892c04545b6d11d457bc0519d` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:50.745141 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:50.750533 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66f6ba-14af-40f0-a008-db39859a60f3 None admin] RBAC: Authorizing `identity:get_user(user_id=91e6f13892c04545b6d11d457bc0519d)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:50.752328 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66f6ba-14af-40f0-a008-db39859a60f3 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:50.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 106/216] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:50 2022] GET /identity/v3/users/91e6f13892c04545b6d11d457bc0519d => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:50.762633 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66f6ba-14af-40f0-a008-db39859a60f3 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:50.820015 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30cf50-1e76-441f-a0b7-0573030ec152 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:50.858526 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68629c24-d757-4ed0-a1d1-200c555ea169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:50.859268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68629c24-d757-4ed0-a1d1-200c555ea169 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:50.859545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68629c24-d757-4ed0-a1d1-200c555ea169 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:50.859806 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68629c24-d757-4ed0-a1d1-200c555ea169 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:50.860501 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68629c24-d757-4ed0-a1d1-200c555ea169 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:50.861972 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68629c24-d757-4ed0-a1d1-200c555ea169 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:50.887405 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:50.896909 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66f6ba-14af-40f0-a008-db39859a60f3 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:50.897658 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 111/217] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Aug 6 20:35:50 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:35:50.943117 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330e2d7-55d2-4e42-b12f-68f387e4c43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:50.944061 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330e2d7-55d2-4e42-b12f-68f387e4c43f None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:50.944541 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330e2d7-55d2-4e42-b12f-68f387e4c43f None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:50.944946 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330e2d7-55d2-4e42-b12f-68f387e4c43f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:50.958955 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd15995-2d32-432e-a7ef-671b5d475a4c None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:50.959318 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd15995-2d32-432e-a7ef-671b5d475a4c None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:50.959473 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd15995-2d32-432e-a7ef-671b5d475a4c None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:50.960840 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 112/218] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:35:50.967320 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc51e9-016a-44bc-a524-ebb2b303b2d8 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:50.967598 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc51e9-016a-44bc-a524-ebb2b303b2d8 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:50.967855 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc51e9-016a-44bc-a524-ebb2b303b2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:50.988286 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-7fbc51e9-016a-44bc-a524-ebb2b303b2d8 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:50.990126 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-7fbc51e9-016a-44bc-a524-ebb2b303b2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:51.042240 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330e2d7-55d2-4e42-b12f-68f387e4c43f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:51.043804 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330e2d7-55d2-4e42-b12f-68f387e4c43f None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:51.069951 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 113/219] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:35:51.071709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31710f9-2a2e-403d-9fa2-78447e20c61a None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:51.071987 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31710f9-2a2e-403d-9fa2-78447e20c61a None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:51.072369 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31710f9-2a2e-403d-9fa2-78447e20c61a None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:51.074487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 114/220] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:51.080264 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0a997-11fb-4f26-ad54-8e9b8ab59ea0 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:51.080556 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0a997-11fb-4f26-ad54-8e9b8ab59ea0 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:51.080817 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0a997-11fb-4f26-ad54-8e9b8ab59ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:51.102115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-7ea0a997-11fb-4f26-ad54-8e9b8ab59ea0 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:51.103978 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-7ea0a997-11fb-4f26-ad54-8e9b8ab59ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:51.132592 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:51.158361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:51.173954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 107/221] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:35:51.175694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330e2d7-55d2-4e42-b12f-68f387e4c43f None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:51.194793 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 115/222] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:35:51.197346 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0a997-11fb-4f26-ad54-8e9b8ab59ea0 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:51.321417 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330e2d7-55d2-4e42-b12f-68f387e4c43f None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:51.357185 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0a997-11fb-4f26-ad54-8e9b8ab59ea0 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:51.377477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79233769-f3c6-4abe-b756-96147e4ebced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:51.378516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233769-f3c6-4abe-b756-96147e4ebced None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:51.379028 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233769-f3c6-4abe-b756-96147e4ebced None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:51.379481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233769-f3c6-4abe-b756-96147e4ebced None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:51.397698 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79233769-f3c6-4abe-b756-96147e4ebced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:51.397923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f9be-34ae-4571-a4fc-79ee458728d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:51.398410 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f9be-34ae-4571-a4fc-79ee458728d3 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:51.398725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f9be-34ae-4571-a4fc-79ee458728d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:51.398994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f9be-34ae-4571-a4fc-79ee458728d3 None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:51.400557 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53f9be-34ae-4571-a4fc-79ee458728d3 None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:51.401993 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53f9be-34ae-4571-a4fc-79ee458728d3 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:51.404118 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 116/223] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:51 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:51.405065 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f9be-34ae-4571-a4fc-79ee458728d3 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-79233769-f3c6-4abe-b756-96147e4ebced None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:51.407229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:51.409170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:51.410863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:51.410863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:51.410863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:51.410863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:51.410863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:51.410863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:51.410863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:51.410863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:51.410863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:51.410863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:51.410863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:51.410863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:51.410863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 108/224] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:35:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:51.418632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79233769-f3c6-4abe-b756-96147e4ebced None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:51.435142 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:51.508289 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:51.540283 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f9be-34ae-4571-a4fc-79ee458728d3 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:51.585393 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03233f7-4913-4f74-8dfc-3489a7c20d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:51.586823 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03233f7-4913-4f74-8dfc-3489a7c20d46 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:51.587296 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03233f7-4913-4f74-8dfc-3489a7c20d46 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:51.587839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03233f7-4913-4f74-8dfc-3489a7c20d46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:51.590056 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79233769-f3c6-4abe-b756-96147e4ebced None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:51.604652 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03233f7-4913-4f74-8dfc-3489a7c20d46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-e03233f7-4913-4f74-8dfc-3489a7c20d46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:51.610455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:51.611306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:51.612079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:51.612079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:51.612079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:51.612079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:51.612079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:51.612079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:51.612079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:51.612079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:51.612079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:51.612079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:51.612079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:35:51.612079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:35:51.612079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 117/225] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:35:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:51.613188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03233f7-4913-4f74-8dfc-3489a7c20d46 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:51.656670 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659d5e2-45d7-46e6-8b3c-6f525fad5cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:51.657659 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659d5e2-45d7-46e6-8b3c-6f525fad5cda None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:51.658128 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659d5e2-45d7-46e6-8b3c-6f525fad5cda None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:51.658602 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659d5e2-45d7-46e6-8b3c-6f525fad5cda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:51.659968 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659d5e2-45d7-46e6-8b3c-6f525fad5cda None admin] RBAC: Adding query filter params (role.id=3b2a5b7c44354447b2bcac96e039c227, scope.project.id=dc297353000a4a698d3362cde7e2f1bf, user.id=91e6f13892c04545b6d11d457bc0519d) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:51.660438 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659d5e2-45d7-46e6-8b3c-6f525fad5cda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:51.663088 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659d5e2-45d7-46e6-8b3c-6f525fad5cda None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:51.672644 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 109/226] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:51 2022] GET /identity/v3/role_assignments?user.id=91e6f13892c04545b6d11d457bc0519d&scope.project.id=dc297353000a4a698d3362cde7e2f1bf&role.id=3b2a5b7c44354447b2bcac96e039c227 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:51.673987 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659d5e2-45d7-46e6-8b3c-6f525fad5cda None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:51.723049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:51.779845 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03233f7-4913-4f74-8dfc-3489a7c20d46 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:51.816931 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659d5e2-45d7-46e6-8b3c-6f525fad5cda None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:51.845435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:51.850785 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdf8a8-f5e2-41b2-a5ef-6f1b961051f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:51.852047 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdf8a8-f5e2-41b2-a5ef-6f1b961051f7 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:51.852650 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdf8a8-f5e2-41b2-a5ef-6f1b961051f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:51.852928 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdf8a8-f5e2-41b2-a5ef-6f1b961051f7 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:51.853628 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdf8a8-f5e2-41b2-a5ef-6f1b961051f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:51.853933 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdf8a8-f5e2-41b2-a5ef-6f1b961051f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:51.856896 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdf8a8-f5e2-41b2-a5ef-6f1b961051f7 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:51.868536 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 118/227] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:51.874775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdf8a8-f5e2-41b2-a5ef-6f1b961051f7 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:51.891609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ec4a5-ab68-4432-8de2-53d01b3f9a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:51.892239 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ec4a5-ab68-4432-8de2-53d01b3f9a7d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:51.892513 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ec4a5-ab68-4432-8de2-53d01b3f9a7d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:51.892787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ec4a5-ab68-4432-8de2-53d01b3f9a7d None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:51.893450 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ec4a5-ab68-4432-8de2-53d01b3f9a7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:51.893751 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ec4a5-ab68-4432-8de2-53d01b3f9a7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:51.895176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ec4a5-ab68-4432-8de2-53d01b3f9a7d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:51.907745 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 110/228] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:35:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:51.913175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ec4a5-ab68-4432-8de2-53d01b3f9a7d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:52.004303 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdf8a8-f5e2-41b2-a5ef-6f1b961051f7 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:52.046084 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7dd92-32b4-4934-ac7f-406397310e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:52.046768 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7dd92-32b4-4934-ac7f-406397310e4d None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:52.047046 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7dd92-32b4-4934-ac7f-406397310e4d None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:52.048393 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7dd92-32b4-4934-ac7f-406397310e4d None admin] PATH_INFO: `/v3/users/c10942df74ab44d2a808533c0955504f` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:52.049612 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7dd92-32b4-4934-ac7f-406397310e4d None admin] RBAC: Authorizing `identity:get_user(user_id=c10942df74ab44d2a808533c0955504f)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:52.051205 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7dd92-32b4-4934-ac7f-406397310e4d None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:52.053084 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 119/229] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:51 2022] GET /identity/v3/users/c10942df74ab44d2a808533c0955504f => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:52.058799 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7dd92-32b4-4934-ac7f-406397310e4d None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:52.079534 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:52.125423 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ec4a5-ab68-4432-8de2-53d01b3f9a7d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:52.167980 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7dd92-32b4-4934-ac7f-406397310e4d None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:52.201605 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae76d8d-bdfc-4c6d-9c4c-1ee455a3fa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:52.202412 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae76d8d-bdfc-4c6d-9c4c-1ee455a3fa47 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:52.202722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae76d8d-bdfc-4c6d-9c4c-1ee455a3fa47 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:52.203001 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae76d8d-bdfc-4c6d-9c4c-1ee455a3fa47 None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:52.204111 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae76d8d-bdfc-4c6d-9c4c-1ee455a3fa47 None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:52.205654 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae76d8d-bdfc-4c6d-9c4c-1ee455a3fa47 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:52.207595 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 120/230] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:52 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:52.215724 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae76d8d-bdfc-4c6d-9c4c-1ee455a3fa47 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:52.223349 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd794770-1259-4049-bcff-141f0ca0b38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:52.224234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd794770-1259-4049-bcff-141f0ca0b38f None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:52.224515 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd794770-1259-4049-bcff-141f0ca0b38f None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:52.224782 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd794770-1259-4049-bcff-141f0ca0b38f None admin] PATH_INFO: `/v3/users/c10942df74ab44d2a808533c0955504f` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:52.230847 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd794770-1259-4049-bcff-141f0ca0b38f None admin] RBAC: Authorizing `identity:get_user(user_id=c10942df74ab44d2a808533c0955504f)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:52.232313 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd794770-1259-4049-bcff-141f0ca0b38f None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:52.233915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 111/231] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:51 2022] GET /identity/v3/users/c10942df74ab44d2a808533c0955504f => generated 283 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:52.239375 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd794770-1259-4049-bcff-141f0ca0b38f None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:52.311629 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:52.372663 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:52.397657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd794770-1259-4049-bcff-141f0ca0b38f None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:52.424706 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae76d8d-bdfc-4c6d-9c4c-1ee455a3fa47 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:52.489599 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3f977-05cd-4d34-91f7-e527425a631d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:52.490641 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3f977-05cd-4d34-91f7-e527425a631d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:52.491104 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3f977-05cd-4d34-91f7-e527425a631d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:52.491584 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3f977-05cd-4d34-91f7-e527425a631d None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:52.493112 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3f977-05cd-4d34-91f7-e527425a631d None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:52.494845 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3f977-05cd-4d34-91f7-e527425a631d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:52.497434 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 112/232] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:52 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:52.508228 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3f977-05cd-4d34-91f7-e527425a631d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:52.551207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40e649-363b-4106-bab2-201a2cae30d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:52.567586 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40e649-363b-4106-bab2-201a2cae30d7 None admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:52.567858 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40e649-363b-4106-bab2-201a2cae30d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:52.568136 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40e649-363b-4106-bab2-201a2cae30d7 None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf/users/c10942df74ab44d2a808533c0955504f/roles/e62e78acab6b46f6a866b4980700caae` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:52.571752 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40e649-363b-4106-bab2-201a2cae30d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc297353000a4a698d3362cde7e2f1bf, user_id=c10942df74ab44d2a808533c0955504f, role_id=e62e78acab6b46f6a866b4980700caae)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:52.573345 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40e649-363b-4106-bab2-201a2cae30d7 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:52.621151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 121/233] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:35:52 2022] PUT /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf/users/c10942df74ab44d2a808533c0955504f/roles/e62e78acab6b46f6a866b4980700caae => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:35:52.809024 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3f977-05cd-4d34-91f7-e527425a631d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:52.829388 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:52.865467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb850b-9364-43b7-85d5-0c35c554572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:52.865467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb850b-9364-43b7-85d5-0c35c554572a None admin] REQUEST_METHOD: `PUT` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:52.865467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb850b-9364-43b7-85d5-0c35c554572a None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:52.865467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb850b-9364-43b7-85d5-0c35c554572a None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf/users/c10942df74ab44d2a808533c0955504f/roles/273b4b42102c497baaeced73ebb2ba7f` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:52.870234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb850b-9364-43b7-85d5-0c35c554572a None admin] RBAC: Authorizing `identity:create_grant(project_id=dc297353000a4a698d3362cde7e2f1bf, user_id=c10942df74ab44d2a808533c0955504f, role_id=273b4b42102c497baaeced73ebb2ba7f)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:52.873654 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb850b-9364-43b7-85d5-0c35c554572a None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:52.907900 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 113/234] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:35:52 2022] PUT /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf/users/c10942df74ab44d2a808533c0955504f/roles/273b4b42102c497baaeced73ebb2ba7f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:35:53.785300 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a42e5-e9c0-4ef8-93e9-8de801acbf9d None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:53.785818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a42e5-e9c0-4ef8-93e9-8de801acbf9d None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:53.785818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a42e5-e9c0-4ef8-93e9-8de801acbf9d None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:53.787354 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 122/235] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:53.796485 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a293f31-6e40-43d4-8193-5e756a7c3875 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:53.796898 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a293f31-6e40-43d4-8193-5e756a7c3875 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:53.797176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a293f31-6e40-43d4-8193-5e756a7c3875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:53.827083 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-1a293f31-6e40-43d4-8193-5e756a7c3875 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:53.828301 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-1a293f31-6e40-43d4-8193-5e756a7c3875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:53.916269 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 114/236] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:53.956107 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a42e5-e9c0-4ef8-93e9-8de801acbf9d None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:54.044658 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aa947-4fba-4f11-a4dd-f0f6dd79c2da None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:54.045262 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aa947-4fba-4f11-a4dd-f0f6dd79c2da None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:54.045727 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aa947-4fba-4f11-a4dd-f0f6dd79c2da None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:54.049136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 115/237] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:54.058773 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617bbb5-b656-43d1-b763-6c676d26f39e None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:54.059625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617bbb5-b656-43d1-b763-6c676d26f39e None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:54.061482 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617bbb5-b656-43d1-b763-6c676d26f39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:54.095062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-b617bbb5-b656-43d1-b763-6c676d26f39e None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:54.101132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-b617bbb5-b656-43d1-b763-6c676d26f39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:54.146733 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a42e5-e9c0-4ef8-93e9-8de801acbf9d None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:54.208942 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3414fd1-ca2c-4eed-b881-88139e2b537f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:54.210802 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3414fd1-ca2c-4eed-b881-88139e2b537f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:54.212625 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3414fd1-ca2c-4eed-b881-88139e2b537f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:54.213793 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3414fd1-ca2c-4eed-b881-88139e2b537f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:54.238670 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 116/238] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:54.239779 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3414fd1-ca2c-4eed-b881-88139e2b537f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-e3414fd1-ca2c-4eed-b881-88139e2b537f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:54.245839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:54.246729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:54.247689 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:54.247689 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:54.247689 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:54.247689 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:54.247689 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:54.247689 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:54.247689 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:54.247689 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:54.247689 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:54.247689 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:54.247689 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:35:54.247689 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:35:54.253711 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 123/239] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:54.256051 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617bbb5-b656-43d1-b763-6c676d26f39e None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:54.283864 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3414fd1-ca2c-4eed-b881-88139e2b537f None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:54.300381 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:54.311758 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:54.442434 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617bbb5-b656-43d1-b763-6c676d26f39e None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:54.471732 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3414fd1-ca2c-4eed-b881-88139e2b537f None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:54.511866 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36ecdf-90a6-4206-b91a-a78b4c641369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:54.512484 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36ecdf-90a6-4206-b91a-a78b4c641369 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:54.512755 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36ecdf-90a6-4206-b91a-a78b4c641369 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:54.513019 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36ecdf-90a6-4206-b91a-a78b4c641369 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:54.513744 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36ecdf-90a6-4206-b91a-a78b4c641369 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:54.514041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36ecdf-90a6-4206-b91a-a78b4c641369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:54.515668 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36ecdf-90a6-4206-b91a-a78b4c641369 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:54.534760 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 117/240] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:35:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:54.536372 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24072f6-3b0d-4d43-9fd8-13c596ae6774 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:54.536755 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24072f6-3b0d-4d43-9fd8-13c596ae6774 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:54.537132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24072f6-3b0d-4d43-9fd8-13c596ae6774 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:54.538100 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44521ea-a338-43fa-a341-941481a6d616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:54.538932 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 118/241] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:54.539059 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44521ea-a338-43fa-a341-941481a6d616 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:54.539134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44521ea-a338-43fa-a341-941481a6d616 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:54.540871 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44521ea-a338-43fa-a341-941481a6d616 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:54.540983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24072f6-3b0d-4d43-9fd8-13c596ae6774 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:54.544916 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44521ea-a338-43fa-a341-941481a6d616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:54.546389 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44521ea-a338-43fa-a341-941481a6d616 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:54.548325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 124/242] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:35:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:54.549593 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5c30a-e17c-4c62-8b3b-50bbe8da311c None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:54.549767 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5c30a-e17c-4c62-8b3b-50bbe8da311c None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:54.550024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5c30a-e17c-4c62-8b3b-50bbe8da311c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:54.575514 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-0bb5c30a-e17c-4c62-8b3b-50bbe8da311c None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:54.576977 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-0bb5c30a-e17c-4c62-8b3b-50bbe8da311c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:54.643827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 125/243] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:54.644997 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5c30a-e17c-4c62-8b3b-50bbe8da311c None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:54.652483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:54.662970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:54.665213 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24072f6-3b0d-4d43-9fd8-13c596ae6774 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:54.714422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b840c-86a2-414b-8f87-f39293f1d09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:54.715119 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b840c-86a2-414b-8f87-f39293f1d09d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:54.715393 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b840c-86a2-414b-8f87-f39293f1d09d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:54.715661 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b840c-86a2-414b-8f87-f39293f1d09d None admin] PATH_INFO: `/v3/users/a33eb380ebee4a8eaccdb0c51d0f468d` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:54.730172 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b840c-86a2-414b-8f87-f39293f1d09d None admin] RBAC: Authorizing `identity:get_user(user_id=a33eb380ebee4a8eaccdb0c51d0f468d)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:54.731681 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b840c-86a2-414b-8f87-f39293f1d09d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:54.733512 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 119/244] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:54 2022] GET /identity/v3/users/a33eb380ebee4a8eaccdb0c51d0f468d => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:54.734287 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b840c-86a2-414b-8f87-f39293f1d09d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:54.759680 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5c30a-e17c-4c62-8b3b-50bbe8da311c None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:54.801711 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba746d-fc23-4ff6-96de-9499bcd84e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:54.803293 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba746d-fc23-4ff6-96de-9499bcd84e8d None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:54.803572 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba746d-fc23-4ff6-96de-9499bcd84e8d None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:54.803841 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba746d-fc23-4ff6-96de-9499bcd84e8d None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:54.804484 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba746d-fc23-4ff6-96de-9499bcd84e8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:54.806045 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba746d-fc23-4ff6-96de-9499bcd84e8d None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:54.834421 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 126/245] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Aug 6 20:35:54 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:35:54.840336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba746d-fc23-4ff6-96de-9499bcd84e8d None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:54.860145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b840c-86a2-414b-8f87-f39293f1d09d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:54.935141 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fafc2-8143-42f7-83a9-57b7085abb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:54.936194 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fafc2-8143-42f7-83a9-57b7085abb90 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:54.936710 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fafc2-8143-42f7-83a9-57b7085abb90 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:54.937165 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fafc2-8143-42f7-83a9-57b7085abb90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:54.960047 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fafc2-8143-42f7-83a9-57b7085abb90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:54.963035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-de6fafc2-8143-42f7-83a9-57b7085abb90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:54.970098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:54.971082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:54.971854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:54.971854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:54.971854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:54.971854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:54.971854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:54.971854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:54.971854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:54.971854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:54.971854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:54.971854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:54.971854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:54.971854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:54.976927 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 120/246] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:54.983018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fafc2-8143-42f7-83a9-57b7085abb90 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:55.013844 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:55.053247 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba746d-fc23-4ff6-96de-9499bcd84e8d None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:55.117512 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d2bc0-b948-4243-920b-a2d28c818ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:55.119300 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d2bc0-b948-4243-920b-a2d28c818ce6 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:55.120320 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d2bc0-b948-4243-920b-a2d28c818ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:55.120736 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d2bc0-b948-4243-920b-a2d28c818ce6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:55.134175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fafc2-8143-42f7-83a9-57b7085abb90 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:55.187777 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548613c-cc01-437a-8d62-6e18ea91166d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:55.189301 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548613c-cc01-437a-8d62-6e18ea91166d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:55.189301 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548613c-cc01-437a-8d62-6e18ea91166d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:55.189301 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548613c-cc01-437a-8d62-6e18ea91166d None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:55.190054 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548613c-cc01-437a-8d62-6e18ea91166d None admin] RBAC: Adding query filter params (name=member) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:55.190451 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548613c-cc01-437a-8d62-6e18ea91166d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:55.194578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548613c-cc01-437a-8d62-6e18ea91166d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:55.206773 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 121/247] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:35:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:55.213702 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548613c-cc01-437a-8d62-6e18ea91166d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:55.237967 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d2bc0-b948-4243-920b-a2d28c818ce6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:55.241315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d2bc0-b948-4243-920b-a2d28c818ce6 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:55.303791 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:55.345585 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:55.354287 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 127/248] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:35:55.360526 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d2bc0-b948-4243-920b-a2d28c818ce6 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:55.373720 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548613c-cc01-437a-8d62-6e18ea91166d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:55.415885 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635227c-3d48-4204-bdf4-a9e50ad53b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:55.416530 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635227c-3d48-4204-bdf4-a9e50ad53b73 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:55.416804 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635227c-3d48-4204-bdf4-a9e50ad53b73 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:55.417069 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635227c-3d48-4204-bdf4-a9e50ad53b73 None admin] PATH_INFO: `/v3/users/91e6f13892c04545b6d11d457bc0519d` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:55.418536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635227c-3d48-4204-bdf4-a9e50ad53b73 None admin] RBAC: Authorizing `identity:get_user(user_id=91e6f13892c04545b6d11d457bc0519d)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:55.419701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635227c-3d48-4204-bdf4-a9e50ad53b73 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:55.421640 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 122/249] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:55 2022] GET /identity/v3/users/91e6f13892c04545b6d11d457bc0519d => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:55.422914 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8077ea-e33c-487d-aa45-162e9cc26ed1 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:55.423190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8077ea-e33c-487d-aa45-162e9cc26ed1 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:55.424124 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8077ea-e33c-487d-aa45-162e9cc26ed1 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:55.425322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 123/250] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:55.429996 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8077ea-e33c-487d-aa45-162e9cc26ed1 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:55.496404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d2bc0-b948-4243-920b-a2d28c818ce6 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:55.556553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2bcc9-7289-4b05-9d21-1f0cceeb77fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:55.557268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2bcc9-7289-4b05-9d21-1f0cceeb77fa None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:55.557542 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2bcc9-7289-4b05-9d21-1f0cceeb77fa None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:55.557810 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2bcc9-7289-4b05-9d21-1f0cceeb77fa None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:55.559690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2bcc9-7289-4b05-9d21-1f0cceeb77fa None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:55.561204 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2bcc9-7289-4b05-9d21-1f0cceeb77fa None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:55.572513 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 128/251] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:55 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:55.573997 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3022-bdcf-40b3-beab-22c5e1ec1677 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:55.576281 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3022-bdcf-40b3-beab-22c5e1ec1677 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:55.576582 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3022-bdcf-40b3-beab-22c5e1ec1677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:55.609651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-5e9a3022-bdcf-40b3-beab-22c5e1ec1677 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:55.610859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-5e9a3022-bdcf-40b3-beab-22c5e1ec1677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:55.613486 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8077ea-e33c-487d-aa45-162e9cc26ed1 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:55.630922 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:55.668706 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be416bbb-7296-4d0b-9b31-e6b5d243a529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:55.669359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be416bbb-7296-4d0b-9b31-e6b5d243a529 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:55.669632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be416bbb-7296-4d0b-9b31-e6b5d243a529 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:55.669899 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be416bbb-7296-4d0b-9b31-e6b5d243a529 None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:55.674368 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be416bbb-7296-4d0b-9b31-e6b5d243a529 None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:55.678793 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be416bbb-7296-4d0b-9b31-e6b5d243a529 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:55.682322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 124/252] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:55 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:55.683422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be416bbb-7296-4d0b-9b31-e6b5d243a529 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:55.715383 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:55.738372 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 129/253] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:55.739183 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a3022-bdcf-40b3-beab-22c5e1ec1677 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:55.833569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be416bbb-7296-4d0b-9b31-e6b5d243a529 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:55.870260 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f546a70-3dd5-414c-8c3b-d24ed5327120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:55.870975 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f546a70-3dd5-414c-8c3b-d24ed5327120 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:55.871055 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a3022-bdcf-40b3-beab-22c5e1ec1677 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:55.871380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f546a70-3dd5-414c-8c3b-d24ed5327120 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:55.871549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f546a70-3dd5-414c-8c3b-d24ed5327120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:55.872221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f546a70-3dd5-414c-8c3b-d24ed5327120 None admin] RBAC: Adding query filter params (role.id=895af4bcf7524c659872539f2eb1eebe, scope.project.id=dc297353000a4a698d3362cde7e2f1bf, user.id=a33eb380ebee4a8eaccdb0c51d0f468d) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:55.872719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f546a70-3dd5-414c-8c3b-d24ed5327120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:55.875198 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f546a70-3dd5-414c-8c3b-d24ed5327120 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:55.881597 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 125/254] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:55 2022] GET /identity/v3/role_assignments?user.id=a33eb380ebee4a8eaccdb0c51d0f468d&scope.project.id=dc297353000a4a698d3362cde7e2f1bf&role.id=895af4bcf7524c659872539f2eb1eebe => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:55.883017 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d582830-bd2c-463a-b552-b00d1055bf57 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:55.883677 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d582830-bd2c-463a-b552-b00d1055bf57 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:55.883963 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d582830-bd2c-463a-b552-b00d1055bf57 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:55.885723 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 126/255] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:55.890942 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d582830-bd2c-463a-b552-b00d1055bf57 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:55.945280 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ebe48-de15-442c-bf34-afed04d10a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:55.946366 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ebe48-de15-442c-bf34-afed04d10a40 None admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:55.946681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ebe48-de15-442c-bf34-afed04d10a40 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:55.946959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ebe48-de15-442c-bf34-afed04d10a40 None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf/users/91e6f13892c04545b6d11d457bc0519d/roles/3b2a5b7c44354447b2bcac96e039c227` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:55.951600 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ebe48-de15-442c-bf34-afed04d10a40 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc297353000a4a698d3362cde7e2f1bf, user_id=91e6f13892c04545b6d11d457bc0519d, role_id=3b2a5b7c44354447b2bcac96e039c227)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:55.954601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ebe48-de15-442c-bf34-afed04d10a40 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:55.982500 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 130/256] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:35:55 2022] PUT /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf/users/91e6f13892c04545b6d11d457bc0519d/roles/3b2a5b7c44354447b2bcac96e039c227 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:35:55.983935 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ac021-d73c-4906-8fa8-1c2b3534669f None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:55.984375 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ac021-d73c-4906-8fa8-1c2b3534669f None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:55.984657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ac021-d73c-4906-8fa8-1c2b3534669f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:56.020091 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-3c8ac021-d73c-4906-8fa8-1c2b3534669f None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:56.023197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-3c8ac021-d73c-4906-8fa8-1c2b3534669f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:56.047861 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:56.054182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:56.108791 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d582830-bd2c-463a-b552-b00d1055bf57 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:56.165389 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 131/257] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:56.175750 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ba1f2-dbdf-44cc-9261-090d62e9d662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:56.176464 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ba1f2-dbdf-44cc-9261-090d62e9d662 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:56.176746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ba1f2-dbdf-44cc-9261-090d62e9d662 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:56.177017 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ba1f2-dbdf-44cc-9261-090d62e9d662 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:56.193518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ba1f2-dbdf-44cc-9261-090d62e9d662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-e07ba1f2-dbdf-44cc-9261-090d62e9d662 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:56.198699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:56.199606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:56.200367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:56.200367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:56.200367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:56.200367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:56.200367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:56.200367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:56.200367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:56.200367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:56.200367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:56.200367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:56.200367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:35:56.200367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:56.200367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 127/258] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:35:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:56.206034 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ac021-d73c-4906-8fa8-1c2b3534669f None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:56.232233 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ba1f2-dbdf-44cc-9261-090d62e9d662 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:56.397125 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ac021-d73c-4906-8fa8-1c2b3534669f None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:56.414311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ba1f2-dbdf-44cc-9261-090d62e9d662 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:56.467337 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eeca89-15c4-4866-addb-a9b4bcec7051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:56.467884 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eeca89-15c4-4866-addb-a9b4bcec7051 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:56.468161 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eeca89-15c4-4866-addb-a9b4bcec7051 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:56.468430 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eeca89-15c4-4866-addb-a9b4bcec7051 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:56.469102 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eeca89-15c4-4866-addb-a9b4bcec7051 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:56.469746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eeca89-15c4-4866-addb-a9b4bcec7051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:56.473075 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eeca89-15c4-4866-addb-a9b4bcec7051 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:56.486643 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 132/259] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:56.490602 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f7bf8-f169-4bd6-9591-591b71d354ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:56.491563 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f7bf8-f169-4bd6-9591-591b71d354ec None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:56.491983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f7bf8-f169-4bd6-9591-591b71d354ec None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:56.492386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f7bf8-f169-4bd6-9591-591b71d354ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:56.495700 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eeca89-15c4-4866-addb-a9b4bcec7051 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:56.502063 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:56.513708 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f7bf8-f169-4bd6-9591-591b71d354ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:56.518780 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-2e8f7bf8-f169-4bd6-9591-591b71d354ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:56.519138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:56.519995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:56.520744 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:56.520744 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:56.520744 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:56.520744 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:56.520744 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:56.520744 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:56.520744 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:56.520744 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:56.520744 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:56.520744 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:56.520744 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:35:56.520744 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:56.523737 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 128/260] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:35:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:35:56.530335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f7bf8-f169-4bd6-9591-591b71d354ec None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:56.702663 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eeca89-15c4-4866-addb-a9b4bcec7051 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:56.745137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3aeb54-99d4-4408-979a-daf55010c16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:56.745802 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aeb54-99d4-4408-979a-daf55010c16f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:56.746080 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aeb54-99d4-4408-979a-daf55010c16f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:56.746349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aeb54-99d4-4408-979a-daf55010c16f None admin] PATH_INFO: `/v3/users/c10942df74ab44d2a808533c0955504f` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:56.749826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3aeb54-99d4-4408-979a-daf55010c16f None admin] RBAC: Authorizing `identity:get_user(user_id=c10942df74ab44d2a808533c0955504f)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:56.751326 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3aeb54-99d4-4408-979a-daf55010c16f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:56.758923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f7bf8-f169-4bd6-9591-591b71d354ec None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:56.760444 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 133/261] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:56 2022] GET /identity/v3/users/c10942df74ab44d2a808533c0955504f => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:56.761312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3aeb54-99d4-4408-979a-daf55010c16f None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:56.816911 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7f14a-61f0-4cbd-99da-341a2bf4f438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:56.817530 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7f14a-61f0-4cbd-99da-341a2bf4f438 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:56.817807 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7f14a-61f0-4cbd-99da-341a2bf4f438 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:56.818078 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7f14a-61f0-4cbd-99da-341a2bf4f438 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:56.818781 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7f14a-61f0-4cbd-99da-341a2bf4f438 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:56.819085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7f14a-61f0-4cbd-99da-341a2bf4f438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:56.820636 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7f14a-61f0-4cbd-99da-341a2bf4f438 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:56.835059 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 129/262] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:35:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:56.836409 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7f14a-61f0-4cbd-99da-341a2bf4f438 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:56.922799 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:56.923611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:56.965568 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7f14a-61f0-4cbd-99da-341a2bf4f438 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:56.976003 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3aeb54-99d4-4408-979a-daf55010c16f None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:57.001483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54fdf5-b239-47c6-b0f4-2ffcbf052f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:57.002040 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54fdf5-b239-47c6-b0f4-2ffcbf052f47 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:57.002315 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54fdf5-b239-47c6-b0f4-2ffcbf052f47 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:57.002614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54fdf5-b239-47c6-b0f4-2ffcbf052f47 None admin] PATH_INFO: `/v3/users/c10942df74ab44d2a808533c0955504f` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:57.003756 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54fdf5-b239-47c6-b0f4-2ffcbf052f47 None admin] RBAC: Authorizing `identity:get_user(user_id=c10942df74ab44d2a808533c0955504f)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:57.005207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54fdf5-b239-47c6-b0f4-2ffcbf052f47 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:57.007299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 130/263] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:56 2022] GET /identity/v3/users/c10942df74ab44d2a808533c0955504f => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:57.013673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54fdf5-b239-47c6-b0f4-2ffcbf052f47 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:57.033133 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab5684-b91e-4845-abe9-ab15ec115495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:57.033759 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab5684-b91e-4845-abe9-ab15ec115495 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:57.034039 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab5684-b91e-4845-abe9-ab15ec115495 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:57.034316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab5684-b91e-4845-abe9-ab15ec115495 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:57.123274 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54fdf5-b239-47c6-b0f4-2ffcbf052f47 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:57.143445 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab5684-b91e-4845-abe9-ab15ec115495 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:57.144925 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab5684-b91e-4845-abe9-ab15ec115495 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:57.160907 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eb57d-cd0a-422c-ae09-744923707f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:57.161548 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb57d-cd0a-422c-ae09-744923707f8b None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:57.161890 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb57d-cd0a-422c-ae09-744923707f8b None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:57.162159 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb57d-cd0a-422c-ae09-744923707f8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:57.162938 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:57.235806 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328eb57d-cd0a-422c-ae09-744923707f8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:57.237419 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328eb57d-cd0a-422c-ae09-744923707f8b None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:57.304633 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:57.351037 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 134/264] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:35:57.357482 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab5684-b91e-4845-abe9-ab15ec115495 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:57.420319 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 131/265] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:35:57.426270 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eb57d-cd0a-422c-ae09-744923707f8b None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:57.471693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:57.521680 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab5684-b91e-4845-abe9-ab15ec115495 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:57.596511 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d268fa-3758-41ee-baff-26a6dca8b665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:57.601405 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d268fa-3758-41ee-baff-26a6dca8b665 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:57.601405 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d268fa-3758-41ee-baff-26a6dca8b665 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:57.601405 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d268fa-3758-41ee-baff-26a6dca8b665 None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:57.601405 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d268fa-3758-41ee-baff-26a6dca8b665 None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:57.601405 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d268fa-3758-41ee-baff-26a6dca8b665 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:57.610224 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 135/266] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:57 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:57.618615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d268fa-3758-41ee-baff-26a6dca8b665 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:57.669386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eb57d-cd0a-422c-ae09-744923707f8b None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:57.709593 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:57.715465 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd7899-6a3c-4292-ba9e-eeec4647a30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:57.716124 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd7899-6a3c-4292-ba9e-eeec4647a30a None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:57.716395 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd7899-6a3c-4292-ba9e-eeec4647a30a None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:57.716691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd7899-6a3c-4292-ba9e-eeec4647a30a None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:57.717972 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd7899-6a3c-4292-ba9e-eeec4647a30a None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:57.719799 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd7899-6a3c-4292-ba9e-eeec4647a30a None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:57.723500 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 132/267] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:35:57 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:57.732658 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd7899-6a3c-4292-ba9e-eeec4647a30a None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:57.834879 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d268fa-3758-41ee-baff-26a6dca8b665 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:57.871255 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:57.876734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd7899-6a3c-4292-ba9e-eeec4647a30a None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:57.911309 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1543f87-c523-4c8e-9c83-cc97a0f996c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:57.912240 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1543f87-c523-4c8e-9c83-cc97a0f996c0 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:57.912542 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e7b40-cb5c-43f4-b5ad-c7b43aba43f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:57.912923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1543f87-c523-4c8e-9c83-cc97a0f996c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:57.913153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e7b40-cb5c-43f4-b5ad-c7b43aba43f8 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:57.913429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e7b40-cb5c-43f4-b5ad-c7b43aba43f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:57.913699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e7b40-cb5c-43f4-b5ad-c7b43aba43f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:57.913891 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1543f87-c523-4c8e-9c83-cc97a0f996c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:57.914423 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e7b40-cb5c-43f4-b5ad-c7b43aba43f8 None admin] RBAC: Adding query filter params (role.id=273b4b42102c497baaeced73ebb2ba7f, scope.project.id=dc297353000a4a698d3362cde7e2f1bf, user.id=c10942df74ab44d2a808533c0955504f) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:57.915082 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1543f87-c523-4c8e-9c83-cc97a0f996c0 None admin] RBAC: Adding query filter params (role.id=e62e78acab6b46f6a866b4980700caae, scope.project.id=dc297353000a4a698d3362cde7e2f1bf, user.id=c10942df74ab44d2a808533c0955504f) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:57.915181 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e7b40-cb5c-43f4-b5ad-c7b43aba43f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:57.915645 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1543f87-c523-4c8e-9c83-cc97a0f996c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:57.916561 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e7b40-cb5c-43f4-b5ad-c7b43aba43f8 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:57.917454 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1543f87-c523-4c8e-9c83-cc97a0f996c0 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:57.922741 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 133/268] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:57 2022] GET /identity/v3/role_assignments?user.id=c10942df74ab44d2a808533c0955504f&scope.project.id=dc297353000a4a698d3362cde7e2f1bf&role.id=273b4b42102c497baaeced73ebb2ba7f => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:57.930760 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 136/269] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:35:57 2022] GET /identity/v3/role_assignments?user.id=c10942df74ab44d2a808533c0955504f&scope.project.id=dc297353000a4a698d3362cde7e2f1bf&role.id=e62e78acab6b46f6a866b4980700caae => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:58.227842 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d88223-6e68-451e-88d7-1c4f69b2f416 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:58.228359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d88223-6e68-451e-88d7-1c4f69b2f416 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:58.228359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d88223-6e68-451e-88d7-1c4f69b2f416 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:58.230071 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 134/270] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:58.236109 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689c3b7-cef9-4f3b-b7e8-6fd2b568bdff None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:58.236677 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689c3b7-cef9-4f3b-b7e8-6fd2b568bdff None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:58.237128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689c3b7-cef9-4f3b-b7e8-6fd2b568bdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:58.263807 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-2689c3b7-cef9-4f3b-b7e8-6fd2b568bdff None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:58.265048 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-2689c3b7-cef9-4f3b-b7e8-6fd2b568bdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:58.350174 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063f6e7-b987-4789-a6b7-c57f821c01a2 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:58.350512 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063f6e7-b987-4789-a6b7-c57f821c01a2 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:58.350733 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063f6e7-b987-4789-a6b7-c57f821c01a2 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:58.351251 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 137/271] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:58.353306 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 135/272] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:58.357435 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d920e-40a2-46f3-8181-4c4f35e41fdc None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:58.357715 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d920e-40a2-46f3-8181-4c4f35e41fdc None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:58.357987 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d920e-40a2-46f3-8181-4c4f35e41fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:58.387834 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063f6e7-b987-4789-a6b7-c57f821c01a2 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:58.500833 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-da3d920e-40a2-46f3-8181-4c4f35e41fdc None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:58.502017 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-da3d920e-40a2-46f3-8181-4c4f35e41fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:58.535646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:58.539439 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063f6e7-b987-4789-a6b7-c57f821c01a2 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:58.581346 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 138/273] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:58.591203 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a8962-2605-430d-876e-35cceab1d06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:58.591837 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a8962-2605-430d-876e-35cceab1d06d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:58.592107 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a8962-2605-430d-876e-35cceab1d06d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:58.592371 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a8962-2605-430d-876e-35cceab1d06d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:58.593505 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a8962-2605-430d-876e-35cceab1d06d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:58.595361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a8962-2605-430d-876e-35cceab1d06d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:58.597045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 136/274] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:35:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:58.603057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d920e-40a2-46f3-8181-4c4f35e41fdc None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:58.607413 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a8962-2605-430d-876e-35cceab1d06d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:58.636667 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:58.713596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a8962-2605-430d-876e-35cceab1d06d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:58.717140 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d920e-40a2-46f3-8181-4c4f35e41fdc None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:58.748243 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc36a4-2f08-414f-b212-259ecb14fc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:58.749238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc36a4-2f08-414f-b212-259ecb14fc77 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:58.749730 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc36a4-2f08-414f-b212-259ecb14fc77 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:58.750230 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc36a4-2f08-414f-b212-259ecb14fc77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:58.755551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c2db2-f580-4ea2-91ad-e09267e82a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:58.756161 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c2db2-f580-4ea2-91ad-e09267e82a3c None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:58.756436 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c2db2-f580-4ea2-91ad-e09267e82a3c None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:58.756704 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c2db2-f580-4ea2-91ad-e09267e82a3c None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:58.757509 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c2db2-f580-4ea2-91ad-e09267e82a3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:58.760688 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c2db2-f580-4ea2-91ad-e09267e82a3c None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:58.762671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc36a4-2f08-414f-b212-259ecb14fc77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-5bdc36a4-2f08-414f-b212-259ecb14fc77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:58.768422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:58.769261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:58.770018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:58.770018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:58.770018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:58.770018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:58.770018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:58.770018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:58.770018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:58.770018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:58.770018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:58.770018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:58.770018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:58.770018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:58.777907 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 137/275] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:35:58.779406 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc36a4-2f08-414f-b212-259ecb14fc77 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:58.788209 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 139/276] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Aug 6 20:35:58 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:35:58.904770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:58.924332 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc36a4-2f08-414f-b212-259ecb14fc77 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:58.964162 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd42814-14ed-44d9-ad71-ee3fab7d85fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:58.965039 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd42814-14ed-44d9-ad71-ee3fab7d85fd None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:58.965450 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd42814-14ed-44d9-ad71-ee3fab7d85fd None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:58.965844 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd42814-14ed-44d9-ad71-ee3fab7d85fd None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:58.966866 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd42814-14ed-44d9-ad71-ee3fab7d85fd None admin] RBAC: Adding query filter params (name=member) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:58.967302 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd42814-14ed-44d9-ad71-ee3fab7d85fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:58.968847 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd42814-14ed-44d9-ad71-ee3fab7d85fd None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:58.979576 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 138/277] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:35:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:58.985376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c2db2-f580-4ea2-91ad-e09267e82a3c None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:59.018120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:59.109264 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c2db2-f580-4ea2-91ad-e09267e82a3c None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:59.152314 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64eb3a-5bb6-420f-8fc0-f0bdd7289ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:59.153198 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64eb3a-5bb6-420f-8fc0-f0bdd7289ec8 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:59.153609 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64eb3a-5bb6-420f-8fc0-f0bdd7289ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:59.154121 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64eb3a-5bb6-420f-8fc0-f0bdd7289ec8 None admin] PATH_INFO: `/v3/users/09b767975e724a209698ca544d394fa3` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:59.172103 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64eb3a-5bb6-420f-8fc0-f0bdd7289ec8 None admin] RBAC: Authorizing `identity:get_user(user_id=09b767975e724a209698ca544d394fa3)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:59.173850 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64eb3a-5bb6-420f-8fc0-f0bdd7289ec8 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:59.176124 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 140/278] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:58 2022] GET /identity/v3/users/09b767975e724a209698ca544d394fa3 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:59.182242 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd42814-14ed-44d9-ad71-ee3fab7d85fd None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:59.246250 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c89f3-7b40-4889-90fa-81107a391a0c None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:59.246827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c89f3-7b40-4889-90fa-81107a391a0c None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:59.247229 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c89f3-7b40-4889-90fa-81107a391a0c None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:59.250097 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 141/279] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:35:59.257587 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7023-751e-453c-a7c0-633dff06aa2d None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:59.258130 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7023-751e-453c-a7c0-633dff06aa2d None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:59.258710 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7023-751e-453c-a7c0-633dff06aa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:59.277947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-7abf7023-751e-453c-a7c0-633dff06aa2d None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:59.279373 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-7abf7023-751e-453c-a7c0-633dff06aa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:59.304946 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd42814-14ed-44d9-ad71-ee3fab7d85fd None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:59.338833 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa3f90-c94c-41ba-9196-d3a0efd03fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:59.339442 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa3f90-c94c-41ba-9196-d3a0efd03fb7 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:59.339717 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa3f90-c94c-41ba-9196-d3a0efd03fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:59.340135 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa3f90-c94c-41ba-9196-d3a0efd03fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:59.340759 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa3f90-c94c-41ba-9196-d3a0efd03fb7 None admin] RBAC: Adding query filter params (role.id=3b2a5b7c44354447b2bcac96e039c227, user.id=09b767975e724a209698ca544d394fa3, scope.system=all) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:59.341073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa3f90-c94c-41ba-9196-d3a0efd03fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:59.342512 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa3f90-c94c-41ba-9196-d3a0efd03fb7 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:59.348483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 139/280] 10.222.0.36 () {56 vars in 1308 bytes} [Sat Aug 6 20:35:59 2022] GET /identity/v3/role_assignments?user.id=09b767975e724a209698ca544d394fa3&scope.system=all&role.id=3b2a5b7c44354447b2bcac96e039c227 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:35:59.352536 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 142/281] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:35:59.376460 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa3f90-c94c-41ba-9196-d3a0efd03fb7 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:59.393158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:59.394780 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54654d0a-3146-4779-9a52-0055dcea819e None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:59.395038 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54654d0a-3146-4779-9a52-0055dcea819e None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:59.395302 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54654d0a-3146-4779-9a52-0055dcea819e None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:59.396656 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 143/282] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:35:59.402069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736ff31-0d6b-4744-a5da-39655e7590a1 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:59.402347 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736ff31-0d6b-4744-a5da-39655e7590a1 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:59.402656 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736ff31-0d6b-4744-a5da-39655e7590a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:59.423167 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-9736ff31-0d6b-4744-a5da-39655e7590a1 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:59.424357 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-9736ff31-0d6b-4744-a5da-39655e7590a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:59.435910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:59.517662 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 144/283] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:35:59.522640 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa3f90-c94c-41ba-9196-d3a0efd03fb7 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:59.544164 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736ff31-0d6b-4744-a5da-39655e7590a1 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:59.593634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adce97-8391-4f46-9d08-e051126021e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:59.594281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adce97-8391-4f46-9d08-e051126021e4 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:59.594947 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adce97-8391-4f46-9d08-e051126021e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:59.595213 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adce97-8391-4f46-9d08-e051126021e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:59.606442 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adce97-8391-4f46-9d08-e051126021e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-23adce97-8391-4f46-9d08-e051126021e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:59.611469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:59.612333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:59.613336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:59.613336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:59.613336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:59.613336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:59.613336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:59.613336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:59.613336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:59.613336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:59.613336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:59.613336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:59.613336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:35:59.613336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:35:59.613336 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 140/284] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:35:59.621464 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adce97-8391-4f46-9d08-e051126021e4 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:59.673743 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736ff31-0d6b-4744-a5da-39655e7590a1 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:59.711244 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c1a8a-88bf-4bf1-a98e-546e051d8715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:59.711944 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c1a8a-88bf-4bf1-a98e-546e051d8715 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:59.712222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c1a8a-88bf-4bf1-a98e-546e051d8715 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:59.713015 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c1a8a-88bf-4bf1-a98e-546e051d8715 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:59.724842 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:59.725649 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c1a8a-88bf-4bf1-a98e-546e051d8715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-b55c1a8a-88bf-4bf1-a98e-546e051d8715 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:35:59.731414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:35:59.732317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:35:59.733081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:35:59.733081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:35:59.733081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:35:59.733081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:35:59.733081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:35:59.733081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:35:59.733081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:35:59.733081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:35:59.733081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:35:59.733081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:35:59.733081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:35:59.733081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:35:59.734149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 145/285] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:35:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:35:59.740249 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c1a8a-88bf-4bf1-a98e-546e051d8715 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:59.827726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:59.850309 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c1a8a-88bf-4bf1-a98e-546e051d8715 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:59.885155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adce97-8391-4f46-9d08-e051126021e4 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:59.918483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d186a9b-7d56-4051-83ee-6da25b8992ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:59.919146 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d186a9b-7d56-4051-83ee-6da25b8992ec None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:59.919420 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d186a9b-7d56-4051-83ee-6da25b8992ec None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:59.919680 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d186a9b-7d56-4051-83ee-6da25b8992ec None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:59.920338 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d186a9b-7d56-4051-83ee-6da25b8992ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:59.920633 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d186a9b-7d56-4051-83ee-6da25b8992ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:59.922009 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d186a9b-7d56-4051-83ee-6da25b8992ec None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:59.927465 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e72031-da9a-4c9e-ad12-628bcf860e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:59.928096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e72031-da9a-4c9e-ad12-628bcf860e68 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:59.928369 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e72031-da9a-4c9e-ad12-628bcf860e68 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:59.928638 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e72031-da9a-4c9e-ad12-628bcf860e68 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:59.929313 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e72031-da9a-4c9e-ad12-628bcf860e68 None admin] RBAC: Adding query filter params (name=member) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:35:59.929611 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e72031-da9a-4c9e-ad12-628bcf860e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:59.931304 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 141/286] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:35:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:59.931700 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e72031-da9a-4c9e-ad12-628bcf860e68 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:59.939829 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d186a9b-7d56-4051-83ee-6da25b8992ec None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:59.954128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 146/287] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:35:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:59.959345 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e72031-da9a-4c9e-ad12-628bcf860e68 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:00.087061 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:00.128162 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d186a9b-7d56-4051-83ee-6da25b8992ec None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:00.143861 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e72031-da9a-4c9e-ad12-628bcf860e68 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:00.183469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269fe81-62e2-4b5a-bd9f-1cadc19dd84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:00.184182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269fe81-62e2-4b5a-bd9f-1cadc19dd84e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:00.184453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269fe81-62e2-4b5a-bd9f-1cadc19dd84e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:00.184715 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269fe81-62e2-4b5a-bd9f-1cadc19dd84e None admin] PATH_INFO: `/v3/users/a33eb380ebee4a8eaccdb0c51d0f468d` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:00.186307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269fe81-62e2-4b5a-bd9f-1cadc19dd84e None admin] RBAC: Authorizing `identity:get_user(user_id=a33eb380ebee4a8eaccdb0c51d0f468d)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:00.187781 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269fe81-62e2-4b5a-bd9f-1cadc19dd84e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:00.190322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 142/288] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:59 2022] GET /identity/v3/users/a33eb380ebee4a8eaccdb0c51d0f468d => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:00.198280 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269fe81-62e2-4b5a-bd9f-1cadc19dd84e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:00.210915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:00.215323 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d681bc-8fb3-47b2-9ef0-e20e7a3507ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:00.215977 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d681bc-8fb3-47b2-9ef0-e20e7a3507ca None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:00.216302 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d681bc-8fb3-47b2-9ef0-e20e7a3507ca None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:00.216578 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d681bc-8fb3-47b2-9ef0-e20e7a3507ca None admin] PATH_INFO: `/v3/users/91e6f13892c04545b6d11d457bc0519d` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:00.218696 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d681bc-8fb3-47b2-9ef0-e20e7a3507ca None admin] RBAC: Authorizing `identity:get_user(user_id=91e6f13892c04545b6d11d457bc0519d)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:00.221747 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d681bc-8fb3-47b2-9ef0-e20e7a3507ca None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:00.225392 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 147/289] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:35:59 2022] GET /identity/v3/users/91e6f13892c04545b6d11d457bc0519d => generated 297 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:00.231631 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d681bc-8fb3-47b2-9ef0-e20e7a3507ca None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:00.335190 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d681bc-8fb3-47b2-9ef0-e20e7a3507ca None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:00.367212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:00.372524 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1a0c7-09b3-4527-88cf-aa81695bc7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:00.373358 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1a0c7-09b3-4527-88cf-aa81695bc7d3 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:00.373635 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1a0c7-09b3-4527-88cf-aa81695bc7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:00.373918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1a0c7-09b3-4527-88cf-aa81695bc7d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:00.401604 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269fe81-62e2-4b5a-bd9f-1cadc19dd84e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:00.444267 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1a0c7-09b3-4527-88cf-aa81695bc7d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:00.445963 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1a0c7-09b3-4527-88cf-aa81695bc7d3 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:00.479407 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2192ef-7043-44d6-98c5-0d79b4389aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:00.479968 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2192ef-7043-44d6-98c5-0d79b4389aa8 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:00.480245 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2192ef-7043-44d6-98c5-0d79b4389aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:00.480512 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2192ef-7043-44d6-98c5-0d79b4389aa8 None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:00.482808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2192ef-7043-44d6-98c5-0d79b4389aa8 None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:00.484371 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2192ef-7043-44d6-98c5-0d79b4389aa8 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:00.486499 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 143/290] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:00 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:00.491712 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2192ef-7043-44d6-98c5-0d79b4389aa8 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:00.614960 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:00.625544 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 148/291] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:00.631297 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1a0c7-09b3-4527-88cf-aa81695bc7d3 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:00.663150 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:00.687407 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2192ef-7043-44d6-98c5-0d79b4389aa8 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:00.741381 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1a0c7-09b3-4527-88cf-aa81695bc7d3 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:00.783752 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2469c-2b06-4f6e-842a-1ccb26e5e5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:00.784387 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2469c-2b06-4f6e-842a-1ccb26e5e5f7 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:00.784671 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2469c-2b06-4f6e-842a-1ccb26e5e5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:00.784928 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2469c-2b06-4f6e-842a-1ccb26e5e5f7 None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:00.786478 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2469c-2b06-4f6e-842a-1ccb26e5e5f7 None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:00.787940 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2469c-2b06-4f6e-842a-1ccb26e5e5f7 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:00.789816 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 149/292] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:00 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:00.791651 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717aab2d-30bd-4051-acaf-902b3270362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:00.792325 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aab2d-30bd-4051-acaf-902b3270362a None admin] REQUEST_METHOD: `PUT` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:00.792598 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aab2d-30bd-4051-acaf-902b3270362a None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:00.792867 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aab2d-30bd-4051-acaf-902b3270362a None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf/users/a33eb380ebee4a8eaccdb0c51d0f468d/roles/895af4bcf7524c659872539f2eb1eebe` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:00.794807 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717aab2d-30bd-4051-acaf-902b3270362a None admin] RBAC: Authorizing `identity:create_grant(project_id=dc297353000a4a698d3362cde7e2f1bf, user_id=a33eb380ebee4a8eaccdb0c51d0f468d, role_id=895af4bcf7524c659872539f2eb1eebe)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:00.796234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717aab2d-30bd-4051-acaf-902b3270362a None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:00.799385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2469c-2b06-4f6e-842a-1ccb26e5e5f7 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:00.820465 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 144/293] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:36:00 2022] PUT /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf/users/a33eb380ebee4a8eaccdb0c51d0f468d/roles/895af4bcf7524c659872539f2eb1eebe => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:36:00.912315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:00.917002 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2469c-2b06-4f6e-842a-1ccb26e5e5f7 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:00.968650 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648f0a9-10cc-456b-bc36-d3cede98a544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:00.970004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f0a9-10cc-456b-bc36-d3cede98a544 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:00.970498 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f0a9-10cc-456b-bc36-d3cede98a544 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:00.970977 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f0a9-10cc-456b-bc36-d3cede98a544 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:00.971897 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648f0a9-10cc-456b-bc36-d3cede98a544 None admin] RBAC: Adding query filter params (role.id=3b2a5b7c44354447b2bcac96e039c227, scope.project.id=dc297353000a4a698d3362cde7e2f1bf, user.id=91e6f13892c04545b6d11d457bc0519d) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:00.972389 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648f0a9-10cc-456b-bc36-d3cede98a544 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:00.974032 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648f0a9-10cc-456b-bc36-d3cede98a544 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:00.987742 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 150/294] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:36:00 2022] GET /identity/v3/role_assignments?user.id=91e6f13892c04545b6d11d457bc0519d&scope.project.id=dc297353000a4a698d3362cde7e2f1bf&role.id=3b2a5b7c44354447b2bcac96e039c227 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:01.644243 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778866fe-3a76-4492-92fa-4f0538e45cff None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:01.645259 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778866fe-3a76-4492-92fa-4f0538e45cff None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:01.645726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778866fe-3a76-4492-92fa-4f0538e45cff None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:01.647722 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 145/295] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:01.653825 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428a197-dd57-4010-840f-cf447709a8e8 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:01.654772 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428a197-dd57-4010-840f-cf447709a8e8 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:01.655235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428a197-dd57-4010-840f-cf447709a8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:01.674966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-f428a197-dd57-4010-840f-cf447709a8e8 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:01.676443 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-f428a197-dd57-4010-840f-cf447709a8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:01.750279 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 151/296] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:01.770683 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778866fe-3a76-4492-92fa-4f0538e45cff None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:01.793012 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59085aa6-6d6e-42b0-a74c-28fdf9efb82f None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:01.793322 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59085aa6-6d6e-42b0-a74c-28fdf9efb82f None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:01.793680 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59085aa6-6d6e-42b0-a74c-28fdf9efb82f None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:01.795327 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 152/297] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:36:01.800344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e801d38-dd45-4852-9033-d81290880977 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:01.800627 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e801d38-dd45-4852-9033-d81290880977 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:01.800905 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e801d38-dd45-4852-9033-d81290880977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:01.819753 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-9e801d38-dd45-4852-9033-d81290880977 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:01.821130 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-9e801d38-dd45-4852-9033-d81290880977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:01.893083 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778866fe-3a76-4492-92fa-4f0538e45cff None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:01.903827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 153/298] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:36:01.925111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:01.927363 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e801d38-dd45-4852-9033-d81290880977 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:01.931837 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4a09a-3fc5-41a9-8923-f9e562010514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:01.932713 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4a09a-3fc5-41a9-8923-f9e562010514 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:01.933168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4a09a-3fc5-41a9-8923-f9e562010514 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:01.933798 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4a09a-3fc5-41a9-8923-f9e562010514 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:01.935234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4a09a-3fc5-41a9-8923-f9e562010514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:01.937062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4a09a-3fc5-41a9-8923-f9e562010514 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:01.939147 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 146/299] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:01.946325 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4a09a-3fc5-41a9-8923-f9e562010514 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:01.953789 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:02.034931 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e801d38-dd45-4852-9033-d81290880977 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:02.069918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82c214-5b3c-495e-9dd2-672b7f32b660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:02.070547 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82c214-5b3c-495e-9dd2-672b7f32b660 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:02.070908 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82c214-5b3c-495e-9dd2-672b7f32b660 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:02.071177 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82c214-5b3c-495e-9dd2-672b7f32b660 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:02.074419 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4a09a-3fc5-41a9-8923-f9e562010514 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:02.083763 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82c214-5b3c-495e-9dd2-672b7f32b660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-6d82c214-5b3c-495e-9dd2-672b7f32b660 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:02.089207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:02.090053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:02.091571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:02.091571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:02.091571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:02.091571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:02.091571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:02.091571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:02.091571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:02.091571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:02.091571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:02.091571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:02.091571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:36:02.091571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:02.091571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 154/300] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:02.096556 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cc5cf-f611-4170-a5f8-0e7be6ec7e62 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:02.096856 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cc5cf-f611-4170-a5f8-0e7be6ec7e62 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:02.097120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cc5cf-f611-4170-a5f8-0e7be6ec7e62 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:02.099070 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 155/301] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:02.099603 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cc5cf-f611-4170-a5f8-0e7be6ec7e62 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:02.116388 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24ab2b-6ee9-4660-a888-08bf05a0fbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:02.117006 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24ab2b-6ee9-4660-a888-08bf05a0fbda None admin] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:02.117278 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24ab2b-6ee9-4660-a888-08bf05a0fbda None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:02.117550 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24ab2b-6ee9-4660-a888-08bf05a0fbda None admin] PATH_INFO: `/v3/groups` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:02.118216 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24ab2b-6ee9-4660-a888-08bf05a0fbda None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:02.119878 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24ab2b-6ee9-4660-a888-08bf05a0fbda None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:02.154619 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 147/302] 10.222.0.36 () {60 vars in 1134 bytes} [Sat Aug 6 20:36:01 2022] POST /identity/v3/groups => generated 229 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:36:02.154619 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bd2b2-08ef-46db-aca7-b2dc3645d7b6 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:02.154619 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bd2b2-08ef-46db-aca7-b2dc3645d7b6 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:02.154619 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bd2b2-08ef-46db-aca7-b2dc3645d7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:02.172828 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-255bd2b2-08ef-46db-aca7-b2dc3645d7b6 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:02.174150 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-255bd2b2-08ef-46db-aca7-b2dc3645d7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:02.208644 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:02.233454 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cc5cf-f611-4170-a5f8-0e7be6ec7e62 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:02.236008 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:02.266611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 148/303] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:02.283454 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd769bf-d531-46b2-82d1-4f0826a3ba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:02.284105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd769bf-d531-46b2-82d1-4f0826a3ba22 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:02.284387 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd769bf-d531-46b2-82d1-4f0826a3ba22 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:02.284717 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd769bf-d531-46b2-82d1-4f0826a3ba22 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:02.285528 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd769bf-d531-46b2-82d1-4f0826a3ba22 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:02.285630 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bd2b2-08ef-46db-aca7-b2dc3645d7b6 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:02.285826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd769bf-d531-46b2-82d1-4f0826a3ba22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:02.287462 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd769bf-d531-46b2-82d1-4f0826a3ba22 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:02.301243 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 156/304] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:36:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:02.307669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd769bf-d531-46b2-82d1-4f0826a3ba22 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:02.403671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bd2b2-08ef-46db-aca7-b2dc3645d7b6 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:02.429609 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd769bf-d531-46b2-82d1-4f0826a3ba22 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:02.442496 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fa450-ae3b-4b37-b29e-c77092124dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:02.443219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fa450-ae3b-4b37-b29e-c77092124dfd None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:02.443490 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fa450-ae3b-4b37-b29e-c77092124dfd None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:02.443754 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fa450-ae3b-4b37-b29e-c77092124dfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:02.459144 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fa450-ae3b-4b37-b29e-c77092124dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-996fa450-ae3b-4b37-b29e-c77092124dfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:02.464103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:02.464969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:02.466139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:02.466139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:02.466139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:02.466139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:02.466139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:02.466139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:02.466139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:02.466139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:02.466139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:02.466139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:02.466139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:02.466139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:02.466139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 149/305] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:02.471411 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fa450-ae3b-4b37-b29e-c77092124dfd None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:02.486025 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7551a8-c462-4ddc-af11-aba87a95d368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:02.487330 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7551a8-c462-4ddc-af11-aba87a95d368 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:02.487953 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7551a8-c462-4ddc-af11-aba87a95d368 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:02.488490 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7551a8-c462-4ddc-af11-aba87a95d368 None admin] PATH_INFO: `/v3/users/8b3932d2e22e41d98a4a186c22c13513` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:02.506965 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7551a8-c462-4ddc-af11-aba87a95d368 None admin] RBAC: Authorizing `identity:get_user(user_id=8b3932d2e22e41d98a4a186c22c13513)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:02.509142 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7551a8-c462-4ddc-af11-aba87a95d368 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:02.511973 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 157/306] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:36:02 2022] GET /identity/v3/users/8b3932d2e22e41d98a4a186c22c13513 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:02.517191 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7551a8-c462-4ddc-af11-aba87a95d368 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:02.520694 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:02.532626 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:02.595860 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fa450-ae3b-4b37-b29e-c77092124dfd None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:02.631235 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484476b-40da-45fe-9584-cfcfd524c8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:02.631942 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484476b-40da-45fe-9584-cfcfd524c8eb None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:02.632283 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484476b-40da-45fe-9584-cfcfd524c8eb None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:02.632620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484476b-40da-45fe-9584-cfcfd524c8eb None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:02.633454 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484476b-40da-45fe-9584-cfcfd524c8eb None admin] RBAC: Adding query filter params (name=member) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:02.633745 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484476b-40da-45fe-9584-cfcfd524c8eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:02.635369 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484476b-40da-45fe-9584-cfcfd524c8eb None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:02.644487 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 150/307] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:36:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:02.650320 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484476b-40da-45fe-9584-cfcfd524c8eb None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:02.659757 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7551a8-c462-4ddc-af11-aba87a95d368 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:02.707699 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21446509-7323-4a83-b6e2-02466515c87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:02.708797 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21446509-7323-4a83-b6e2-02466515c87d None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:02.709209 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21446509-7323-4a83-b6e2-02466515c87d None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:02.709824 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21446509-7323-4a83-b6e2-02466515c87d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:02.711151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21446509-7323-4a83-b6e2-02466515c87d None admin] RBAC: Adding query filter params (role.id=895af4bcf7524c659872539f2eb1eebe, user.id=8b3932d2e22e41d98a4a186c22c13513, scope.system=all) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:02.711911 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21446509-7323-4a83-b6e2-02466515c87d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:02.714132 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21446509-7323-4a83-b6e2-02466515c87d None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:02.721297 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 158/308] 10.222.0.36 () {56 vars in 1308 bytes} [Sat Aug 6 20:36:02 2022] GET /identity/v3/role_assignments?user.id=8b3932d2e22e41d98a4a186c22c13513&scope.system=all&role.id=895af4bcf7524c659872539f2eb1eebe => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:02.765390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484476b-40da-45fe-9584-cfcfd524c8eb None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:02.778075 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:02.804926 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c290ed-ddb5-4020-b664-62913c44211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:02.805762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c290ed-ddb5-4020-b664-62913c44211b None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:02.806097 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c290ed-ddb5-4020-b664-62913c44211b None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:02.806429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c290ed-ddb5-4020-b664-62913c44211b None admin] PATH_INFO: `/v3/users/09b767975e724a209698ca544d394fa3` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:02.807708 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c290ed-ddb5-4020-b664-62913c44211b None admin] RBAC: Authorizing `identity:get_user(user_id=09b767975e724a209698ca544d394fa3)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:02.809256 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c290ed-ddb5-4020-b664-62913c44211b None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:02.811184 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 151/309] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:36:02 2022] GET /identity/v3/users/09b767975e724a209698ca544d394fa3 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:02.817191 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21446509-7323-4a83-b6e2-02466515c87d None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:02.897119 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:02.940669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21446509-7323-4a83-b6e2-02466515c87d None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:02.977223 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bc37d-12a3-46c6-9c96-bc97d1286784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:02.978272 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bc37d-12a3-46c6-9c96-bc97d1286784 None admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:02.978801 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bc37d-12a3-46c6-9c96-bc97d1286784 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:02.979277 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bc37d-12a3-46c6-9c96-bc97d1286784 None admin] PATH_INFO: `/v3/system/users/09b767975e724a209698ca544d394fa3/roles/3b2a5b7c44354447b2bcac96e039c227` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:02.980981 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bc37d-12a3-46c6-9c96-bc97d1286784 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=09b767975e724a209698ca544d394fa3, role_id=3b2a5b7c44354447b2bcac96e039c227)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:02.982553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bc37d-12a3-46c6-9c96-bc97d1286784 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:02.995460 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 159/310] 10.222.0.36 () {58 vars in 1334 bytes} [Sat Aug 6 20:36:02 2022] PUT /identity/v3/system/users/09b767975e724a209698ca544d394fa3/roles/3b2a5b7c44354447b2bcac96e039c227 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:36:03.369413 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9814de8-1813-4c6a-bdc5-8116bbc0da87 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:03.369801 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9814de8-1813-4c6a-bdc5-8116bbc0da87 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:03.369990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9814de8-1813-4c6a-bdc5-8116bbc0da87 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:03.371349 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 152/311] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:03.376663 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fba55-8a00-44e9-a836-1e1bf696da99 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:03.376940 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fba55-8a00-44e9-a836-1e1bf696da99 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:03.377216 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fba55-8a00-44e9-a836-1e1bf696da99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:03.396041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-e17fba55-8a00-44e9-a836-1e1bf696da99 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:03.397215 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-e17fba55-8a00-44e9-a836-1e1bf696da99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:03.475835 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 160/312] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:03.503463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9814de8-1813-4c6a-bdc5-8116bbc0da87 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:03.608845 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9814de8-1813-4c6a-bdc5-8116bbc0da87 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:03.643326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba62091-6ada-464a-9661-c5272d254a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:03.644477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba62091-6ada-464a-9661-c5272d254a60 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:03.645035 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba62091-6ada-464a-9661-c5272d254a60 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:03.646030 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba62091-6ada-464a-9661-c5272d254a60 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:03.656573 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba62091-6ada-464a-9661-c5272d254a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-cba62091-6ada-464a-9661-c5272d254a60 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:03.661501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:03.662341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:03.663176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:03.663176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:03.663176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:03.663176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:03.663176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:03.663176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:03.663176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:03.663176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:03.663176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:03.663176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:03.663176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:36:03.663176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:03.665511 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 153/313] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:03.671539 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fba55-8a00-44e9-a836-1e1bf696da99 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:03.734100 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:03.778181 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fba55-8a00-44e9-a836-1e1bf696da99 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:03.814037 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a94bdc-8467-4d8b-ac4e-c1474180b427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:03.815128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a94bdc-8467-4d8b-ac4e-c1474180b427 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:03.815719 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a94bdc-8467-4d8b-ac4e-c1474180b427 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:03.816177 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a94bdc-8467-4d8b-ac4e-c1474180b427 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:03.817025 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a94bdc-8467-4d8b-ac4e-c1474180b427 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:03.817535 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a94bdc-8467-4d8b-ac4e-c1474180b427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:03.819168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a94bdc-8467-4d8b-ac4e-c1474180b427 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:03.828247 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 161/314] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:36:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:03.835950 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba62091-6ada-464a-9661-c5272d254a60 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:03.891815 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:03.950780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba62091-6ada-464a-9661-c5272d254a60 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:03.986140 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54635017-ec47-4206-a143-df1b676965c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:03.986814 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54635017-ec47-4206-a143-df1b676965c2 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:03.987086 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54635017-ec47-4206-a143-df1b676965c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:03.987352 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54635017-ec47-4206-a143-df1b676965c2 None admin] PATH_INFO: `/v3/users/a33eb380ebee4a8eaccdb0c51d0f468d` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:03.988481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54635017-ec47-4206-a143-df1b676965c2 None admin] RBAC: Authorizing `identity:get_user(user_id=a33eb380ebee4a8eaccdb0c51d0f468d)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:03.989988 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54635017-ec47-4206-a143-df1b676965c2 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:03.991625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 154/315] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:36:03 2022] GET /identity/v3/users/a33eb380ebee4a8eaccdb0c51d0f468d => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:03.999760 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a94bdc-8467-4d8b-ac4e-c1474180b427 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:04.104863 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a94bdc-8467-4d8b-ac4e-c1474180b427 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:04.127456 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:04.139334 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65c2f8-5adc-485b-aa1d-48068ba24f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:04.139948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65c2f8-5adc-485b-aa1d-48068ba24f31 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:04.140235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65c2f8-5adc-485b-aa1d-48068ba24f31 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:04.140489 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65c2f8-5adc-485b-aa1d-48068ba24f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:04.210779 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65c2f8-5adc-485b-aa1d-48068ba24f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:04.212465 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65c2f8-5adc-485b-aa1d-48068ba24f31 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:04.313064 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 162/316] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:04.319759 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54635017-ec47-4206-a143-df1b676965c2 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:04.429915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54635017-ec47-4206-a143-df1b676965c2 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:04.437281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:04.464517 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef2636-033b-4fcd-812b-87a7190cca56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:04.465077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef2636-033b-4fcd-812b-87a7190cca56 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:04.465350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef2636-033b-4fcd-812b-87a7190cca56 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:04.465616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef2636-033b-4fcd-812b-87a7190cca56 None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:04.466818 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef2636-033b-4fcd-812b-87a7190cca56 None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:04.468371 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef2636-033b-4fcd-812b-87a7190cca56 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:04.470729 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 155/317] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:04 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:04.483947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65c2f8-5adc-485b-aa1d-48068ba24f31 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:04.518936 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:04.531321 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1c9d4-2110-455d-b68c-127a3a989307 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:04.531635 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1c9d4-2110-455d-b68c-127a3a989307 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:04.531863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1c9d4-2110-455d-b68c-127a3a989307 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:04.533994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 156/318] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:36:04.539082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d366eb-eb75-4451-aa8a-540dc76519e6 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:04.539638 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d366eb-eb75-4451-aa8a-540dc76519e6 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:04.540005 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d366eb-eb75-4451-aa8a-540dc76519e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:04.563800 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-85d366eb-eb75-4451-aa8a-540dc76519e6 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:04.565122 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-85d366eb-eb75-4451-aa8a-540dc76519e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:04.591675 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65c2f8-5adc-485b-aa1d-48068ba24f31 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:04.628483 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ded16-fd00-42bc-a711-305c9e601c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:04.629097 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ded16-fd00-42bc-a711-305c9e601c34 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:04.629371 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ded16-fd00-42bc-a711-305c9e601c34 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:04.629640 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ded16-fd00-42bc-a711-305c9e601c34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:04.630547 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ded16-fd00-42bc-a711-305c9e601c34 None admin] RBAC: Adding query filter params (role.id=895af4bcf7524c659872539f2eb1eebe, scope.project.id=dc297353000a4a698d3362cde7e2f1bf, user.id=a33eb380ebee4a8eaccdb0c51d0f468d) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:04.631019 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ded16-fd00-42bc-a711-305c9e601c34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:04.632552 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ded16-fd00-42bc-a711-305c9e601c34 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:04.639174 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 163/319] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:36:04 2022] GET /identity/v3/role_assignments?user.id=a33eb380ebee4a8eaccdb0c51d0f468d&scope.project.id=dc297353000a4a698d3362cde7e2f1bf&role.id=895af4bcf7524c659872539f2eb1eebe => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:04.650623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 157/320] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:04.674537 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ded16-fd00-42bc-a711-305c9e601c34 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:04.777793 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:04.786890 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ded16-fd00-42bc-a711-305c9e601c34 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:04.824101 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55434bbe-ae47-460e-831c-25ad2caafc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:04.824753 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55434bbe-ae47-460e-831c-25ad2caafc55 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:04.825024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55434bbe-ae47-460e-831c-25ad2caafc55 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:04.825290 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55434bbe-ae47-460e-831c-25ad2caafc55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:04.826407 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55434bbe-ae47-460e-831c-25ad2caafc55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:04.827982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55434bbe-ae47-460e-831c-25ad2caafc55 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:04.829871 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 164/321] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:04.835475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d366eb-eb75-4451-aa8a-540dc76519e6 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:04.947045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d366eb-eb75-4451-aa8a-540dc76519e6 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:04.950970 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:04.986277 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfc16b-e158-47ca-9389-8d3907efc0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:04.986918 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfc16b-e158-47ca-9389-8d3907efc0b8 None admin] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:04.987192 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfc16b-e158-47ca-9389-8d3907efc0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:04.987457 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfc16b-e158-47ca-9389-8d3907efc0b8 None admin] PATH_INFO: `/v3/groups` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:04.988072 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfc16b-e158-47ca-9389-8d3907efc0b8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:04.989508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfc16b-e158-47ca-9389-8d3907efc0b8 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:05.006625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 158/322] 10.222.0.36 () {60 vars in 1134 bytes} [Sat Aug 6 20:36:04 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:36:05.106331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12932349-afd8-4254-9016-fea46d56b988 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:05.106509 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12932349-afd8-4254-9016-fea46d56b988 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:05.106795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12932349-afd8-4254-9016-fea46d56b988 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:05.108291 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 165/323] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:05.113778 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fc48e-8ca0-4a99-9cf4-fb7efcf3334a None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:05.114067 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fc48e-8ca0-4a99-9cf4-fb7efcf3334a None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:05.114339 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fc48e-8ca0-4a99-9cf4-fb7efcf3334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:05.133103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-519fc48e-8ca0-4a99-9cf4-fb7efcf3334a None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:05.134482 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-519fc48e-8ca0-4a99-9cf4-fb7efcf3334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:05.222834 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 159/324] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:05.247684 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12932349-afd8-4254-9016-fea46d56b988 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:05.353390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a186db-49ec-420b-9c92-0b1aff57434c None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:05.353656 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a186db-49ec-420b-9c92-0b1aff57434c None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:05.353921 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a186db-49ec-420b-9c92-0b1aff57434c None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:05.355299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 160/325] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:36:05.360739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17f3b1-9b48-4e7d-ae08-f1a9598cacc7 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:05.360950 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17f3b1-9b48-4e7d-ae08-f1a9598cacc7 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:05.361220 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17f3b1-9b48-4e7d-ae08-f1a9598cacc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:05.363476 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12932349-afd8-4254-9016-fea46d56b988 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:05.382373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-dd17f3b1-9b48-4e7d-ae08-f1a9598cacc7 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:05.386140 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-dd17f3b1-9b48-4e7d-ae08-f1a9598cacc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:05.411625 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f50fd-0594-4974-a16b-e6f99fdbe3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:05.412289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f50fd-0594-4974-a16b-e6f99fdbe3cf None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:05.412567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f50fd-0594-4974-a16b-e6f99fdbe3cf None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:05.412834 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f50fd-0594-4974-a16b-e6f99fdbe3cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:05.425435 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f50fd-0594-4974-a16b-e6f99fdbe3cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-dd6f50fd-0594-4974-a16b-e6f99fdbe3cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:05.430519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:05.432087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:05.433069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:05.433069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:05.433069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:05.433069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:05.433069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:05.433069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:05.433069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:05.433069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:05.433069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:05.433069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:05.433069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:36:05.433069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:05.433069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 166/326] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:05.437492 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f50fd-0594-4974-a16b-e6f99fdbe3cf None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:05.457727 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:05.483358 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 161/327] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:36:05.506718 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17f3b1-9b48-4e7d-ae08-f1a9598cacc7 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:05.539397 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:05.588051 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f50fd-0594-4974-a16b-e6f99fdbe3cf None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:05.627598 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b22814-d4fc-443d-a727-cf0f76ddc132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:05.628549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b22814-d4fc-443d-a727-cf0f76ddc132 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:05.629049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b22814-d4fc-443d-a727-cf0f76ddc132 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:05.629504 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b22814-d4fc-443d-a727-cf0f76ddc132 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:05.630347 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b22814-d4fc-443d-a727-cf0f76ddc132 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:05.630894 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b22814-d4fc-443d-a727-cf0f76ddc132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:05.632583 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b22814-d4fc-443d-a727-cf0f76ddc132 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:05.642646 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17f3b1-9b48-4e7d-ae08-f1a9598cacc7 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:05.643810 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 167/328] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:36:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:05.649747 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b22814-d4fc-443d-a727-cf0f76ddc132 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:05.684564 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679d8ee-370e-4666-8066-b37b181e7e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:05.685222 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679d8ee-370e-4666-8066-b37b181e7e57 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:05.685484 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679d8ee-370e-4666-8066-b37b181e7e57 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:05.685752 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679d8ee-370e-4666-8066-b37b181e7e57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:05.697986 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679d8ee-370e-4666-8066-b37b181e7e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-e679d8ee-370e-4666-8066-b37b181e7e57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:05.702827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:05.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:05.704475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:05.704475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:05.704475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:05.704475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:05.704475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:05.704475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:05.704475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:05.704475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:05.704475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:05.704475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:05.704475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:05.704475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:05.704475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 162/329] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:05.710195 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679d8ee-370e-4666-8066-b37b181e7e57 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:05.755087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:05.760287 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b22814-d4fc-443d-a727-cf0f76ddc132 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:05.805417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bc7a8-db23-49ee-ae4b-edd53b6041a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:05.806066 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bc7a8-db23-49ee-ae4b-edd53b6041a1 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:05.806337 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bc7a8-db23-49ee-ae4b-edd53b6041a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:05.806624 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bc7a8-db23-49ee-ae4b-edd53b6041a1 None admin] PATH_INFO: `/v3/users/8b3932d2e22e41d98a4a186c22c13513` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:05.808546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bc7a8-db23-49ee-ae4b-edd53b6041a1 None admin] RBAC: Authorizing `identity:get_user(user_id=8b3932d2e22e41d98a4a186c22c13513)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:05.809981 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bc7a8-db23-49ee-ae4b-edd53b6041a1 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:05.811573 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 168/330] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:36:05 2022] GET /identity/v3/users/8b3932d2e22e41d98a4a186c22c13513 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:05.817831 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bc7a8-db23-49ee-ae4b-edd53b6041a1 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:05.830349 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:05.849113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679d8ee-370e-4666-8066-b37b181e7e57 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:05.888278 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019dcd5-8767-48d8-91bf-c32fdf6e6a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:05.888820 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019dcd5-8767-48d8-91bf-c32fdf6e6a18 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:05.889092 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019dcd5-8767-48d8-91bf-c32fdf6e6a18 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:05.889354 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019dcd5-8767-48d8-91bf-c32fdf6e6a18 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:05.890081 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019dcd5-8767-48d8-91bf-c32fdf6e6a18 None admin] RBAC: Adding query filter params (name=member) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:05.890466 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019dcd5-8767-48d8-91bf-c32fdf6e6a18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:05.892140 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019dcd5-8767-48d8-91bf-c32fdf6e6a18 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:05.901742 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 163/331] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:36:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:05.907221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019dcd5-8767-48d8-91bf-c32fdf6e6a18 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:05.931065 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bc7a8-db23-49ee-ae4b-edd53b6041a1 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:05.966786 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acda7ae-f9c3-420f-8331-c3dd645467b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:05.967609 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acda7ae-f9c3-420f-8331-c3dd645467b4 None admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:05.967890 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acda7ae-f9c3-420f-8331-c3dd645467b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:05.968159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acda7ae-f9c3-420f-8331-c3dd645467b4 None admin] PATH_INFO: `/v3/system/users/8b3932d2e22e41d98a4a186c22c13513/roles/895af4bcf7524c659872539f2eb1eebe` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:05.970025 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acda7ae-f9c3-420f-8331-c3dd645467b4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8b3932d2e22e41d98a4a186c22c13513, role_id=895af4bcf7524c659872539f2eb1eebe)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:05.971572 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acda7ae-f9c3-420f-8331-c3dd645467b4 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:05.984676 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 169/332] 10.222.0.36 () {58 vars in 1334 bytes} [Sat Aug 6 20:36:05 2022] PUT /identity/v3/system/users/8b3932d2e22e41d98a4a186c22c13513/roles/895af4bcf7524c659872539f2eb1eebe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:36:06.024731 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019dcd5-8767-48d8-91bf-c32fdf6e6a18 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:06.064038 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd3530-eca5-427b-9bde-77847d47a010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:06.064737 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd3530-eca5-427b-9bde-77847d47a010 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:06.065012 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd3530-eca5-427b-9bde-77847d47a010 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:06.065342 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd3530-eca5-427b-9bde-77847d47a010 None admin] PATH_INFO: `/v3/users/09b767975e724a209698ca544d394fa3` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:06.066683 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd3530-eca5-427b-9bde-77847d47a010 None admin] RBAC: Authorizing `identity:get_user(user_id=09b767975e724a209698ca544d394fa3)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:06.068324 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd3530-eca5-427b-9bde-77847d47a010 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:06.070295 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 164/333] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:36:05 2022] GET /identity/v3/users/09b767975e724a209698ca544d394fa3 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:06.076327 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acda7ae-f9c3-420f-8331-c3dd645467b4 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:06.095734 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:06.212496 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acda7ae-f9c3-420f-8331-c3dd645467b4 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:06.257207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21839b0-2b95-4aa0-a204-5d1d3e9f3173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:06.258363 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21839b0-2b95-4aa0-a204-5d1d3e9f3173 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:06.258877 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21839b0-2b95-4aa0-a204-5d1d3e9f3173 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:06.259446 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21839b0-2b95-4aa0-a204-5d1d3e9f3173 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:06.260432 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21839b0-2b95-4aa0-a204-5d1d3e9f3173 None admin] RBAC: Adding query filter params (role.id=3b2a5b7c44354447b2bcac96e039c227, user.id=09b767975e724a209698ca544d394fa3, scope.system=all) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:06.260955 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21839b0-2b95-4aa0-a204-5d1d3e9f3173 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:06.262670 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21839b0-2b95-4aa0-a204-5d1d3e9f3173 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:06.281529 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 170/334] 10.222.0.36 () {56 vars in 1308 bytes} [Sat Aug 6 20:36:06 2022] GET /identity/v3/role_assignments?user.id=09b767975e724a209698ca544d394fa3&scope.system=all&role.id=3b2a5b7c44354447b2bcac96e039c227 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:07.983868 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aae66-65cc-4e1a-850e-5b27315dbfea None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:07.984403 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aae66-65cc-4e1a-850e-5b27315dbfea None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:07.984403 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aae66-65cc-4e1a-850e-5b27315dbfea None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:07.985867 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 165/335] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:07.990927 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c2d4d-9629-4670-9151-684fc0951616 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:07.991311 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c2d4d-9629-4670-9151-684fc0951616 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:07.991493 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c2d4d-9629-4670-9151-684fc0951616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:08.010288 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-862c2d4d-9629-4670-9151-684fc0951616 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:08.011496 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-862c2d4d-9629-4670-9151-684fc0951616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:08.096446 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:08.107915 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 171/336] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:08.154210 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aae66-65cc-4e1a-850e-5b27315dbfea None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:08.175548 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:08.270867 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aae66-65cc-4e1a-850e-5b27315dbfea None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:08.308334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398b665-6f56-44fc-940f-66d3a1845b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:08.308997 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398b665-6f56-44fc-940f-66d3a1845b71 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:08.309448 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398b665-6f56-44fc-940f-66d3a1845b71 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:08.309727 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398b665-6f56-44fc-940f-66d3a1845b71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:08.321238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398b665-6f56-44fc-940f-66d3a1845b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-0398b665-6f56-44fc-940f-66d3a1845b71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:08.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:08.328468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:08.330331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:08.330331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:08.330331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:08.330331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:08.330331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:08.330331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:08.330331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:08.330331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:08.330331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:08.330331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:08.330331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:36:08.330331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:08.330331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 166/337] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:36:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:08.333762 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c2d4d-9629-4670-9151-684fc0951616 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:08.382675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1941ed7-35d9-4065-923a-94b306f216a4 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:08.383160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1941ed7-35d9-4065-923a-94b306f216a4 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:08.383379 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1941ed7-35d9-4065-923a-94b306f216a4 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:08.384785 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 167/338] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:08.390206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19c728-85fd-4b3e-bd15-c74f282ea311 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:08.390487 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19c728-85fd-4b3e-bd15-c74f282ea311 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:08.390784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19c728-85fd-4b3e-bd15-c74f282ea311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:08.424826 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-be19c728-85fd-4b3e-bd15-c74f282ea311 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:08.428793 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-be19c728-85fd-4b3e-bd15-c74f282ea311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:08.537855 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c2d4d-9629-4670-9151-684fc0951616 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:08.586738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c0654-b267-4eb3-98cf-986ed64f2bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:08.587716 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c0654-b267-4eb3-98cf-986ed64f2bfd None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:08.587993 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c0654-b267-4eb3-98cf-986ed64f2bfd None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:08.588254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c0654-b267-4eb3-98cf-986ed64f2bfd None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:08.588922 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c0654-b267-4eb3-98cf-986ed64f2bfd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:08.589373 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c0654-b267-4eb3-98cf-986ed64f2bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:08.591132 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c0654-b267-4eb3-98cf-986ed64f2bfd None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:08.608191 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 172/339] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:08.610242 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 168/340] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:08.618415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c0654-b267-4eb3-98cf-986ed64f2bfd None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:08.639042 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19c728-85fd-4b3e-bd15-c74f282ea311 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:08.648121 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:08.724524 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:08.784237 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19c728-85fd-4b3e-bd15-c74f282ea311 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:08.828275 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9e3f7-9745-478d-9081-eab28890a735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:08.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9e3f7-9745-478d-9081-eab28890a735 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:08.829899 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9e3f7-9745-478d-9081-eab28890a735 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:08.830303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9e3f7-9745-478d-9081-eab28890a735 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:08.843842 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9e3f7-9745-478d-9081-eab28890a735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:08.844059 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c0654-b267-4eb3-98cf-986ed64f2bfd None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-5cf9e3f7-9745-478d-9081-eab28890a735 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:08.850609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:08.851695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:08.852699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:08.852699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:08.852699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:08.852699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:08.852699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:08.852699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:08.852699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:08.852699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:08.852699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:08.852699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:08.852699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:08.852699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:08.855437 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 169/341] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:08.861907 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9e3f7-9745-478d-9081-eab28890a735 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:08.944074 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53c5ec-c59b-4d09-a887-79e12d795c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:08.944721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53c5ec-c59b-4d09-a887-79e12d795c9f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:08.945005 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53c5ec-c59b-4d09-a887-79e12d795c9f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:08.945281 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53c5ec-c59b-4d09-a887-79e12d795c9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:08.979575 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:09.039579 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53c5ec-c59b-4d09-a887-79e12d795c9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:09.041049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53c5ec-c59b-4d09-a887-79e12d795c9f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:09.045042 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9e3f7-9745-478d-9081-eab28890a735 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:09.103036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:09.110174 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bced14-5f8b-4ada-9371-13fea9762c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:09.110823 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bced14-5f8b-4ada-9371-13fea9762c35 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:09.111091 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bced14-5f8b-4ada-9371-13fea9762c35 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:09.111361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bced14-5f8b-4ada-9371-13fea9762c35 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:09.112023 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bced14-5f8b-4ada-9371-13fea9762c35 None admin] RBAC: Adding query filter params (name=member) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:09.112316 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bced14-5f8b-4ada-9371-13fea9762c35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:09.113688 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bced14-5f8b-4ada-9371-13fea9762c35 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:09.125271 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 170/342] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:36:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:09.130771 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bced14-5f8b-4ada-9371-13fea9762c35 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:09.179034 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 173/343] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:09.180107 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53c5ec-c59b-4d09-a887-79e12d795c9f None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:09.268579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bced14-5f8b-4ada-9371-13fea9762c35 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:09.317554 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53c5ec-c59b-4d09-a887-79e12d795c9f None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:09.341113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:09.367857 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61532daf-176a-4d4f-b693-24b20a2d7652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:09.369174 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61532daf-176a-4d4f-b693-24b20a2d7652 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:09.370064 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61532daf-176a-4d4f-b693-24b20a2d7652 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:09.371003 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61532daf-176a-4d4f-b693-24b20a2d7652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:09.372852 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e68295-8f76-4aee-967b-4e690febd901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:09.373693 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e68295-8f76-4aee-967b-4e690febd901 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:09.374134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e68295-8f76-4aee-967b-4e690febd901 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:09.374572 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e68295-8f76-4aee-967b-4e690febd901 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:09.376053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e68295-8f76-4aee-967b-4e690febd901 None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:09.377784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e68295-8f76-4aee-967b-4e690febd901 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:09.380058 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 174/344] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:09 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:09.381492 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4fb26-1aa7-4c04-b247-d96e0b95e0fb None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:09.382011 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4fb26-1aa7-4c04-b247-d96e0b95e0fb None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:09.382532 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4fb26-1aa7-4c04-b247-d96e0b95e0fb None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:09.384321 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 175/345] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:09.385518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d95eb-062b-492d-9460-96f7415c7cea None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:09.386094 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d95eb-062b-492d-9460-96f7415c7cea None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:09.386535 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d95eb-062b-492d-9460-96f7415c7cea None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:09.387940 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 176/346] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:09.389648 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d95eb-062b-492d-9460-96f7415c7cea None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:09.419727 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:09.471179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61532daf-176a-4d4f-b693-24b20a2d7652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:09.474893 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61532daf-176a-4d4f-b693-24b20a2d7652 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:09.524314 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d95eb-062b-492d-9460-96f7415c7cea None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:09.572949 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f5619-612d-4e78-ad31-9fbacd453c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:09.573594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f5619-612d-4e78-ad31-9fbacd453c7e None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:09.573868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f5619-612d-4e78-ad31-9fbacd453c7e None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:09.574194 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f5619-612d-4e78-ad31-9fbacd453c7e None admin] PATH_INFO: `/v3/groups/6c51d8f824eb413b9963e0421eecd614` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:09.582355 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f5619-612d-4e78-ad31-9fbacd453c7e None admin] RBAC: Authorizing `identity:get_group(group_id=6c51d8f824eb413b9963e0421eecd614)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:09.584326 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f5619-612d-4e78-ad31-9fbacd453c7e None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:09.587056 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 177/347] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Aug 6 20:36:09 2022] GET /identity/v3/groups/6c51d8f824eb413b9963e0421eecd614 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:09.588748 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976880b-d8a6-4363-a456-2131ffb85347 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:09.589056 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976880b-d8a6-4363-a456-2131ffb85347 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:09.589336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976880b-d8a6-4363-a456-2131ffb85347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:09.612511 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 171/348] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:36:09.614093 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aabde-143c-41a9-9221-f98bab061cb0 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:09.614710 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aabde-143c-41a9-9221-f98bab061cb0 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:09.615182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aabde-143c-41a9-9221-f98bab061cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:09.615588 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-8976880b-d8a6-4363-a456-2131ffb85347 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:09.616756 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-8976880b-d8a6-4363-a456-2131ffb85347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:09.635814 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-903aabde-143c-41a9-9221-f98bab061cb0 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:09.637295 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-903aabde-143c-41a9-9221-f98bab061cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:09.659709 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:09.698324 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 178/349] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:09.699242 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976880b-d8a6-4363-a456-2131ffb85347 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:09.720634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 172/350] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:09.721827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aabde-143c-41a9-9221-f98bab061cb0 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:09.722569 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:09.806598 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976880b-d8a6-4363-a456-2131ffb85347 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:09.846200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d22cb4-5f67-48f2-a7b1-21208d662498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:09.847240 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d22cb4-5f67-48f2-a7b1-21208d662498 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:09.847692 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aabde-143c-41a9-9221-f98bab061cb0 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:09.847899 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d22cb4-5f67-48f2-a7b1-21208d662498 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:09.848348 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d22cb4-5f67-48f2-a7b1-21208d662498 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:09.849307 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d22cb4-5f67-48f2-a7b1-21208d662498 None admin] RBAC: Adding query filter params (group.id=6c51d8f824eb413b9963e0421eecd614, role.id=273b4b42102c497baaeced73ebb2ba7f, scope.project.id=c120cb6ccb334c1787bda6da7e12c849) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:09.849821 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d22cb4-5f67-48f2-a7b1-21208d662498 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:09.851553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d22cb4-5f67-48f2-a7b1-21208d662498 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:09.858294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 179/351] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Aug 6 20:36:09 2022] GET /identity/v3/role_assignments?group.id=6c51d8f824eb413b9963e0421eecd614&scope.project.id=c120cb6ccb334c1787bda6da7e12c849&role.id=273b4b42102c497baaeced73ebb2ba7f => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:09.859428 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d22cb4-5f67-48f2-a7b1-21208d662498 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:09.893309 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4961d6-3256-4e28-96c5-1b385b80d575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:09.893820 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4961d6-3256-4e28-96c5-1b385b80d575 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:09.894098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4961d6-3256-4e28-96c5-1b385b80d575 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:09.894417 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4961d6-3256-4e28-96c5-1b385b80d575 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:09.896731 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4961d6-3256-4e28-96c5-1b385b80d575 None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:09.898249 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4961d6-3256-4e28-96c5-1b385b80d575 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:09.900914 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 173/352] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:09 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:09.901053 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4961d6-3256-4e28-96c5-1b385b80d575 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:09.931802 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:09.981324 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:10.001913 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d22cb4-5f67-48f2-a7b1-21208d662498 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:10.016330 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4961d6-3256-4e28-96c5-1b385b80d575 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:10.044816 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48002e7e-ac0e-44de-b8fe-6866a194fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:10.047412 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48002e7e-ac0e-44de-b8fe-6866a194fe7c None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:10.047785 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48002e7e-ac0e-44de-b8fe-6866a194fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:10.047956 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48002e7e-ac0e-44de-b8fe-6866a194fe7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:10.060196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e225cf-ee66-4001-b0f8-4448aeecf27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:10.060743 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48002e7e-ac0e-44de-b8fe-6866a194fe7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:10.061514 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e225cf-ee66-4001-b0f8-4448aeecf27e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:10.061923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e225cf-ee66-4001-b0f8-4448aeecf27e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:10.062362 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e225cf-ee66-4001-b0f8-4448aeecf27e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-48002e7e-ac0e-44de-b8fe-6866a194fe7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:10.067120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:10.068245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:10.069049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:10.069049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:10.069049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:10.069049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:10.069049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:10.069049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:10.069049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:10.069049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:10.069049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:10.069049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:10.069049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:10.069049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:10.069049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 180/353] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:10.069741 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48002e7e-ac0e-44de-b8fe-6866a194fe7c None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:10.079405 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e225cf-ee66-4001-b0f8-4448aeecf27e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-b2e225cf-ee66-4001-b0f8-4448aeecf27e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:10.086522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:10.087523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:10.088446 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:10.088446 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:10.088446 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:10.088446 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:10.088446 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:10.088446 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:10.088446 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:10.088446 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:10.088446 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:10.088446 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:10.088446 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:36:10.088446 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:10.091027 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 174/354] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:36:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:10.092810 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c577d2-d3e2-44f2-8ed3-6cfada541d6f None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:10.093246 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c577d2-d3e2-44f2-8ed3-6cfada541d6f None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:10.093646 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c577d2-d3e2-44f2-8ed3-6cfada541d6f None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:10.095656 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 175/355] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:10.096856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c577d2-d3e2-44f2-8ed3-6cfada541d6f None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:10.203775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48002e7e-ac0e-44de-b8fe-6866a194fe7c None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:10.230996 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:10.236929 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c577d2-d3e2-44f2-8ed3-6cfada541d6f None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:10.253785 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca9e3a-a05f-446e-bfb6-2fcd9898b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:10.254696 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca9e3a-a05f-446e-bfb6-2fcd9898b223 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:10.255136 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca9e3a-a05f-446e-bfb6-2fcd9898b223 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:10.255548 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca9e3a-a05f-446e-bfb6-2fcd9898b223 None admin] PATH_INFO: `/v3/groups/6c51d8f824eb413b9963e0421eecd614` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:10.258928 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca9e3a-a05f-446e-bfb6-2fcd9898b223 None admin] RBAC: Authorizing `identity:get_group(group_id=6c51d8f824eb413b9963e0421eecd614)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:10.260573 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca9e3a-a05f-446e-bfb6-2fcd9898b223 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:10.263145 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 181/356] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Aug 6 20:36:10 2022] GET /identity/v3/groups/6c51d8f824eb413b9963e0421eecd614 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:10.264471 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca9e3a-a05f-446e-bfb6-2fcd9898b223 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:10.290368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:10.290809 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f04a8-d74c-4f8e-b0e6-7300f050628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:10.291571 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f04a8-d74c-4f8e-b0e6-7300f050628a None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:10.291908 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f04a8-d74c-4f8e-b0e6-7300f050628a None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:10.292395 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f04a8-d74c-4f8e-b0e6-7300f050628a None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:10.293379 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f04a8-d74c-4f8e-b0e6-7300f050628a None admin] RBAC: Adding query filter params (name=member) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:10.293683 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f04a8-d74c-4f8e-b0e6-7300f050628a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:10.295886 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f04a8-d74c-4f8e-b0e6-7300f050628a None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:10.306137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 176/357] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:36:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:10.307752 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c323-d1ca-418a-9a64-981df4276f5f None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:10.308145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c323-d1ca-418a-9a64-981df4276f5f None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:10.308508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c323-d1ca-418a-9a64-981df4276f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:10.345309 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-e6d8c323-d1ca-418a-9a64-981df4276f5f None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:10.346689 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-e6d8c323-d1ca-418a-9a64-981df4276f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:10.407630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca9e3a-a05f-446e-bfb6-2fcd9898b223 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:10.439431 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 177/358] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:10.440299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8c323-d1ca-418a-9a64-981df4276f5f None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:10.486795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6e121-8bcf-47cc-a470-6a38d05a44ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:10.487433 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6e121-8bcf-47cc-a470-6a38d05a44ae None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:10.488026 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6e121-8bcf-47cc-a470-6a38d05a44ae None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:10.488026 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6e121-8bcf-47cc-a470-6a38d05a44ae None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:10.488631 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6e121-8bcf-47cc-a470-6a38d05a44ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:10.488940 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6e121-8bcf-47cc-a470-6a38d05a44ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:10.490320 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6e121-8bcf-47cc-a470-6a38d05a44ae None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:10.505326 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 182/359] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:10.506028 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6e121-8bcf-47cc-a470-6a38d05a44ae None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:10.525891 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:10.562614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8c323-d1ca-418a-9a64-981df4276f5f None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:10.615146 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:10.621267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee561b4-9c74-472c-8c21-09f96e837e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:10.621899 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee561b4-9c74-472c-8c21-09f96e837e9f None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:10.622173 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee561b4-9c74-472c-8c21-09f96e837e9f None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:10.622461 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee561b4-9c74-472c-8c21-09f96e837e9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:10.623198 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee561b4-9c74-472c-8c21-09f96e837e9f None admin] RBAC: Adding query filter params (group.id=6c51d8f824eb413b9963e0421eecd614, role.id=3b2a5b7c44354447b2bcac96e039c227, scope.project.id=c120cb6ccb334c1787bda6da7e12c849) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:10.623501 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee561b4-9c74-472c-8c21-09f96e837e9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:10.624941 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee561b4-9c74-472c-8c21-09f96e837e9f None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:10.634700 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 178/360] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Aug 6 20:36:10 2022] GET /identity/v3/role_assignments?group.id=6c51d8f824eb413b9963e0421eecd614&scope.project.id=c120cb6ccb334c1787bda6da7e12c849&role.id=3b2a5b7c44354447b2bcac96e039c227 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:10.636332 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee561b4-9c74-472c-8c21-09f96e837e9f None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:10.651398 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6e121-8bcf-47cc-a470-6a38d05a44ae None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:10.704237 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1715a-f512-422b-ae35-d17113a6339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:10.705926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1715a-f512-422b-ae35-d17113a6339d None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:10.706412 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1715a-f512-422b-ae35-d17113a6339d None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:10.706890 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1715a-f512-422b-ae35-d17113a6339d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:10.757483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee561b4-9c74-472c-8c21-09f96e837e9f None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:10.803102 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d381709-ec3f-435c-86b3-52d3678ff432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:10.803921 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d381709-ec3f-435c-86b3-52d3678ff432 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:10.804097 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d381709-ec3f-435c-86b3-52d3678ff432 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:10.804337 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d381709-ec3f-435c-86b3-52d3678ff432 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:10.814166 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1715a-f512-422b-ae35-d17113a6339d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:10.815711 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1715a-f512-422b-ae35-d17113a6339d None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:10.817837 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:10.827290 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d381709-ec3f-435c-86b3-52d3678ff432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-6d381709-ec3f-435c-86b3-52d3678ff432 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:10.834620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:10.835566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:10.836675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:10.836675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:10.836675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:10.836675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:10.836675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:10.836675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:10.836675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:10.836675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:10.836675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:10.836675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:10.836675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:36:10.836675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:10.840094 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 179/361] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:10.841355 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d381709-ec3f-435c-86b3-52d3678ff432 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:10.920878 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:10.948059 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 183/362] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:10.949901 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcca21-72bd-4a42-b1d9-ead9fb0b3f5e None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:10.949901 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcca21-72bd-4a42-b1d9-ead9fb0b3f5e None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:10.949901 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcca21-72bd-4a42-b1d9-ead9fb0b3f5e None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:10.951173 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 184/363] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:10.951866 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcca21-72bd-4a42-b1d9-ead9fb0b3f5e None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:10.979773 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d381709-ec3f-435c-86b3-52d3678ff432 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:11.017638 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d15d5-d8a3-437f-9cb6-1e9521d1ee6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:11.018203 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d15d5-d8a3-437f-9cb6-1e9521d1ee6c None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:11.018478 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d15d5-d8a3-437f-9cb6-1e9521d1ee6c None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:11.018779 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d15d5-d8a3-437f-9cb6-1e9521d1ee6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:11.064107 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcca21-72bd-4a42-b1d9-ead9fb0b3f5e None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:11.089071 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:11.091815 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d15d5-d8a3-437f-9cb6-1e9521d1ee6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:11.093325 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d15d5-d8a3-437f-9cb6-1e9521d1ee6c None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:11.102548 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181da4c-9ef3-4499-8083-74c546d56f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:11.103278 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181da4c-9ef3-4499-8083-74c546d56f91 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:11.103446 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181da4c-9ef3-4499-8083-74c546d56f91 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:11.103753 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181da4c-9ef3-4499-8083-74c546d56f91 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:11.104478 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181da4c-9ef3-4499-8083-74c546d56f91 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:11.104776 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181da4c-9ef3-4499-8083-74c546d56f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:11.106221 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181da4c-9ef3-4499-8083-74c546d56f91 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:11.117901 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 185/364] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:36:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:11.119246 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181da4c-9ef3-4499-8083-74c546d56f91 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:11.165342 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:11.204018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 180/365] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:11.205311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2989d43-221e-4efb-94d6-953ebcde3493 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:11.205595 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2989d43-221e-4efb-94d6-953ebcde3493 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:11.205864 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2989d43-221e-4efb-94d6-953ebcde3493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:11.229902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181da4c-9ef3-4499-8083-74c546d56f91 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:11.230237 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-f2989d43-221e-4efb-94d6-953ebcde3493 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:11.231409 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-f2989d43-221e-4efb-94d6-953ebcde3493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:11.266185 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94024e03-5176-45ff-be87-2ae3207f86c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:11.266944 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94024e03-5176-45ff-be87-2ae3207f86c7 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:11.267222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94024e03-5176-45ff-be87-2ae3207f86c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:11.267490 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94024e03-5176-45ff-be87-2ae3207f86c7 None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:11.268679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94024e03-5176-45ff-be87-2ae3207f86c7 None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:11.270212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94024e03-5176-45ff-be87-2ae3207f86c7 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:11.272386 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 186/366] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:11 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:11.273226 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94024e03-5176-45ff-be87-2ae3207f86c7 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:11.316154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 181/367] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:11.317213 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2989d43-221e-4efb-94d6-953ebcde3493 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:11.364637 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:11.414640 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94024e03-5176-45ff-be87-2ae3207f86c7 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:11.422693 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:11.458204 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ac814-7c95-433d-950b-0c86054eae6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:11.458868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ac814-7c95-433d-950b-0c86054eae6f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:11.459146 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ac814-7c95-433d-950b-0c86054eae6f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:11.459410 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ac814-7c95-433d-950b-0c86054eae6f None admin] PATH_INFO: `/v3/users/8b3932d2e22e41d98a4a186c22c13513` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:11.460544 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ac814-7c95-433d-950b-0c86054eae6f None admin] RBAC: Authorizing `identity:get_user(user_id=8b3932d2e22e41d98a4a186c22c13513)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:11.462135 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ac814-7c95-433d-950b-0c86054eae6f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:11.463929 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 187/368] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Aug 6 20:36:11 2022] GET /identity/v3/users/8b3932d2e22e41d98a4a186c22c13513 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:11.464490 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ac814-7c95-433d-950b-0c86054eae6f None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:11.473055 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2989d43-221e-4efb-94d6-953ebcde3493 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:11.530675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568ee1d-45f7-4030-a395-86443c6a29fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:11.531317 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568ee1d-45f7-4030-a395-86443c6a29fe None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:11.531500 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568ee1d-45f7-4030-a395-86443c6a29fe None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:11.531824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568ee1d-45f7-4030-a395-86443c6a29fe None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:11.532877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568ee1d-45f7-4030-a395-86443c6a29fe None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:11.534328 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568ee1d-45f7-4030-a395-86443c6a29fe None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:11.537405 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 182/369] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:11 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:11.538213 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568ee1d-45f7-4030-a395-86443c6a29fe None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:11.634857 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ac814-7c95-433d-950b-0c86054eae6f None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:11.661494 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:11.666162 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568ee1d-45f7-4030-a395-86443c6a29fe None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:11.702656 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f242b-21cb-4388-a0b5-f378078327c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:11.702656 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f242b-21cb-4388-a0b5-f378078327c0 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:11.702656 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f242b-21cb-4388-a0b5-f378078327c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:11.702656 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f242b-21cb-4388-a0b5-f378078327c0 None admin] PATH_INFO: `/v3/groups/6c51d8f824eb413b9963e0421eecd614` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:11.703093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f242b-21cb-4388-a0b5-f378078327c0 None admin] RBAC: Authorizing `identity:get_group(group_id=6c51d8f824eb413b9963e0421eecd614)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:11.704179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f242b-21cb-4388-a0b5-f378078327c0 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:11.705941 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 188/370] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Aug 6 20:36:11 2022] GET /identity/v3/groups/6c51d8f824eb413b9963e0421eecd614 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:11.706548 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f242b-21cb-4388-a0b5-f378078327c0 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:11.726932 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7bb72-48c5-4097-a77f-d5156651a6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:11.727995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7bb72-48c5-4097-a77f-d5156651a6ed None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:11.728416 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7bb72-48c5-4097-a77f-d5156651a6ed None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:11.728834 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7bb72-48c5-4097-a77f-d5156651a6ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:11.747080 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7bb72-48c5-4097-a77f-d5156651a6ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-38f7bb72-48c5-4097-a77f-d5156651a6ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:11.760311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:11.761429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:11.762468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:11.762468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:11.762468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:11.762468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:11.762468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:11.762468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:11.762468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:11.762468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:11.762468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:11.762468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:11.762468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:36:11.762468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:11.764989 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 183/371] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:36:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:11.766236 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7bb72-48c5-4097-a77f-d5156651a6ed None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:11.782254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:11.871301 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f242b-21cb-4388-a0b5-f378078327c0 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:11.923418 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71c4e9-95b7-4b25-b79e-a59eb0baf8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:11.924144 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71c4e9-95b7-4b25-b79e-a59eb0baf8e4 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:11.924487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71c4e9-95b7-4b25-b79e-a59eb0baf8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:11.924823 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71c4e9-95b7-4b25-b79e-a59eb0baf8e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:11.925990 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71c4e9-95b7-4b25-b79e-a59eb0baf8e4 None admin] RBAC: Adding query filter params (role.id=895af4bcf7524c659872539f2eb1eebe, user.id=8b3932d2e22e41d98a4a186c22c13513, scope.system=all) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:11.926259 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71c4e9-95b7-4b25-b79e-a59eb0baf8e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:11.928267 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71c4e9-95b7-4b25-b79e-a59eb0baf8e4 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:11.931689 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7bb72-48c5-4097-a77f-d5156651a6ed None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:11.950663 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 189/372] 10.222.0.36 () {56 vars in 1308 bytes} [Sat Aug 6 20:36:11 2022] GET /identity/v3/role_assignments?user.id=8b3932d2e22e41d98a4a186c22c13513&scope.system=all&role.id=895af4bcf7524c659872539f2eb1eebe => generated 510 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:11.950663 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71c4e9-95b7-4b25-b79e-a59eb0baf8e4 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:12.016838 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf690a-c993-499e-9493-d8dd40643406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:12.017772 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf690a-c993-499e-9493-d8dd40643406 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:12.018190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf690a-c993-499e-9493-d8dd40643406 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:12.018656 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf690a-c993-499e-9493-d8dd40643406 None admin] PATH_INFO: `/v3/groups/6c51d8f824eb413b9963e0421eecd614` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:12.027951 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf690a-c993-499e-9493-d8dd40643406 None admin] RBAC: Authorizing `identity:get_group(group_id=6c51d8f824eb413b9963e0421eecd614)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:12.030902 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf690a-c993-499e-9493-d8dd40643406 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:12.034059 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 184/373] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Aug 6 20:36:11 2022] GET /identity/v3/groups/6c51d8f824eb413b9963e0421eecd614 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:12.035111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf690a-c993-499e-9493-d8dd40643406 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:12.092483 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:12.093850 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:12.103816 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71c4e9-95b7-4b25-b79e-a59eb0baf8e4 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:12.184457 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb906e-21d9-4515-a31c-92ca52ec1610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:12.185103 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb906e-21d9-4515-a31c-92ca52ec1610 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:12.185383 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb906e-21d9-4515-a31c-92ca52ec1610 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:12.185658 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb906e-21d9-4515-a31c-92ca52ec1610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:12.186403 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb906e-21d9-4515-a31c-92ca52ec1610 None admin] RBAC: Adding query filter params (group.id=6c51d8f824eb413b9963e0421eecd614, role.id=3b2a5b7c44354447b2bcac96e039c227, scope.project.id=dc297353000a4a698d3362cde7e2f1bf) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:12.186740 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb906e-21d9-4515-a31c-92ca52ec1610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:12.189932 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb906e-21d9-4515-a31c-92ca52ec1610 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:12.206479 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 190/374] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Aug 6 20:36:11 2022] GET /identity/v3/role_assignments?group.id=6c51d8f824eb413b9963e0421eecd614&scope.project.id=dc297353000a4a698d3362cde7e2f1bf&role.id=3b2a5b7c44354447b2bcac96e039c227 => generated 260 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:12.207630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb906e-21d9-4515-a31c-92ca52ec1610 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:12.266219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf690a-c993-499e-9493-d8dd40643406 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:12.337559 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144af762-3742-4d23-b705-3a70b03040de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:12.339509 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144af762-3742-4d23-b705-3a70b03040de None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:12.340054 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144af762-3742-4d23-b705-3a70b03040de None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:12.340529 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144af762-3742-4d23-b705-3a70b03040de None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:12.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144af762-3742-4d23-b705-3a70b03040de None admin] RBAC: Adding query filter params (name=admin) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:12.342832 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144af762-3742-4d23-b705-3a70b03040de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:12.345435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144af762-3742-4d23-b705-3a70b03040de None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:12.358155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 185/375] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:12.366519 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144af762-3742-4d23-b705-3a70b03040de None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:12.407391 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb906e-21d9-4515-a31c-92ca52ec1610 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:12.499221 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ed98d-8faa-4407-bcf7-8675d9535443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:12.500247 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ed98d-8faa-4407-bcf7-8675d9535443 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:12.500733 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ed98d-8faa-4407-bcf7-8675d9535443 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:12.501400 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ed98d-8faa-4407-bcf7-8675d9535443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:12.502368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ed98d-8faa-4407-bcf7-8675d9535443 None admin] RBAC: Adding query filter params (group.id=6c51d8f824eb413b9963e0421eecd614, role.id=273b4b42102c497baaeced73ebb2ba7f, scope.project.id=dc297353000a4a698d3362cde7e2f1bf) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:12.502956 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ed98d-8faa-4407-bcf7-8675d9535443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:12.505858 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ed98d-8faa-4407-bcf7-8675d9535443 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:12.512841 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:12.516186 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 191/376] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Aug 6 20:36:12 2022] GET /identity/v3/role_assignments?group.id=6c51d8f824eb413b9963e0421eecd614&scope.project.id=dc297353000a4a698d3362cde7e2f1bf&role.id=273b4b42102c497baaeced73ebb2ba7f => generated 260 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:12.535848 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144af762-3742-4d23-b705-3a70b03040de None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:12.585430 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f133d0-647b-46f4-b0d7-ffc0c811d3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:12.586118 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f133d0-647b-46f4-b0d7-ffc0c811d3bb None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:12.586470 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f133d0-647b-46f4-b0d7-ffc0c811d3bb None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:12.586810 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f133d0-647b-46f4-b0d7-ffc0c811d3bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:12.673623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f133d0-647b-46f4-b0d7-ffc0c811d3bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:12.675136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f133d0-647b-46f4-b0d7-ffc0c811d3bb None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:12.793564 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:12.808385 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 186/377] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:36:12.814068 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ed98d-8faa-4407-bcf7-8675d9535443 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:12.848109 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90029e50-5d91-45b2-9b6e-0adabc9e7b09 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:12.848759 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90029e50-5d91-45b2-9b6e-0adabc9e7b09 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:12.849228 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90029e50-5d91-45b2-9b6e-0adabc9e7b09 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:12.850181 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:12.851863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 187/378] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:36:12.857540 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348ea39-4328-4f26-b969-c955b44d0117 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:12.858201 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348ea39-4328-4f26-b969-c955b44d0117 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:12.858776 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348ea39-4328-4f26-b969-c955b44d0117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:12.889806 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-5348ea39-4328-4f26-b969-c955b44d0117 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:12.892922 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-5348ea39-4328-4f26-b969-c955b44d0117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:12.997917 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ed98d-8faa-4407-bcf7-8675d9535443 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:13.033528 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 188/379] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:13.054029 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58960e11-1dfc-4819-9f05-9e1706cc8626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:13.054699 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58960e11-1dfc-4819-9f05-9e1706cc8626 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:13.055070 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58960e11-1dfc-4819-9f05-9e1706cc8626 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:13.055338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58960e11-1dfc-4819-9f05-9e1706cc8626 None admin] PATH_INFO: `/v3/projects/42f40b6097a64b0993acc9ebaceea81e` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:13.059256 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58960e11-1dfc-4819-9f05-9e1706cc8626 None admin] RBAC: Authorizing `identity:get_project(project_id=42f40b6097a64b0993acc9ebaceea81e)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:13.060695 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58960e11-1dfc-4819-9f05-9e1706cc8626 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:13.062703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 192/380] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:12 2022] GET /identity/v3/projects/42f40b6097a64b0993acc9ebaceea81e => generated 344 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:13.068257 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348ea39-4328-4f26-b969-c955b44d0117 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:13.073994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58960e11-1dfc-4819-9f05-9e1706cc8626 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:13.194245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:13.197689 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348ea39-4328-4f26-b969-c955b44d0117 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:13.201880 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58960e11-1dfc-4819-9f05-9e1706cc8626 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:13.228743 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:13.237792 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a42069-37e6-497e-bc4e-2ad32d533025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:13.239145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a42069-37e6-497e-bc4e-2ad32d533025 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:13.239455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a42069-37e6-497e-bc4e-2ad32d533025 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:13.240060 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a42069-37e6-497e-bc4e-2ad32d533025 None admin] PATH_INFO: `/v3/groups/af1bcf72b1154a908ee82dd59a0f17f0` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:13.242013 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b81d1-f71d-4ecf-8646-b8dcad1b9fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:13.242796 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b81d1-f71d-4ecf-8646-b8dcad1b9fc9 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:13.243073 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b81d1-f71d-4ecf-8646-b8dcad1b9fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:13.243492 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b81d1-f71d-4ecf-8646-b8dcad1b9fc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:13.250513 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a42069-37e6-497e-bc4e-2ad32d533025 None admin] RBAC: Authorizing `identity:get_group(group_id=af1bcf72b1154a908ee82dd59a0f17f0)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:13.252317 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a42069-37e6-497e-bc4e-2ad32d533025 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:13.257328 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 189/381] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Aug 6 20:36:13 2022] GET /identity/v3/groups/af1bcf72b1154a908ee82dd59a0f17f0 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:13.268801 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b81d1-f71d-4ecf-8646-b8dcad1b9fc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-019b81d1-f71d-4ecf-8646-b8dcad1b9fc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:13.274761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:13.275709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:13.276486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:13.276486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:13.276486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:13.276486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:13.276486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:13.276486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:13.276486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:13.276486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:13.276486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:13.276486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:13.276486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:36:13.276486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:13.278854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 193/382] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:36:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:13.280794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a42069-37e6-497e-bc4e-2ad32d533025 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:13.292706 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b81d1-f71d-4ecf-8646-b8dcad1b9fc9 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:13.391666 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a42069-37e6-497e-bc4e-2ad32d533025 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:13.427208 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb1410-7aaa-475f-a2de-4210a17efcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:13.427814 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb1410-7aaa-475f-a2de-4210a17efcb8 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:13.428088 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb1410-7aaa-475f-a2de-4210a17efcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:13.428364 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb1410-7aaa-475f-a2de-4210a17efcb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:13.429116 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb1410-7aaa-475f-a2de-4210a17efcb8 None admin] RBAC: Adding query filter params (group.id=af1bcf72b1154a908ee82dd59a0f17f0, role.id=e62e78acab6b46f6a866b4980700caae, scope.project.id=42f40b6097a64b0993acc9ebaceea81e) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:13.429389 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb1410-7aaa-475f-a2de-4210a17efcb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:13.431504 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb1410-7aaa-475f-a2de-4210a17efcb8 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:13.438052 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 190/383] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Aug 6 20:36:13 2022] GET /identity/v3/role_assignments?group.id=af1bcf72b1154a908ee82dd59a0f17f0&scope.project.id=42f40b6097a64b0993acc9ebaceea81e&role.id=e62e78acab6b46f6a866b4980700caae => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:13.444137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b859f-f29f-4a43-a0a0-7b76b358af63 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:13.444532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b859f-f29f-4a43-a0a0-7b76b358af63 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:13.444788 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b859f-f29f-4a43-a0a0-7b76b358af63 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:13.446675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 191/384] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:13.452419 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27aadc-694e-4313-91bf-dfd20113bf7f None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:13.452734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27aadc-694e-4313-91bf-dfd20113bf7f None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:13.452963 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27aadc-694e-4313-91bf-dfd20113bf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:13.487266 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-0c27aadc-694e-4313-91bf-dfd20113bf7f None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:13.487266 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-0c27aadc-694e-4313-91bf-dfd20113bf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:13.489768 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b81d1-f71d-4ecf-8646-b8dcad1b9fc9 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:13.559640 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73043792-ac84-47be-acd8-a03d94abf2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:13.560184 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73043792-ac84-47be-acd8-a03d94abf2f0 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:13.560456 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73043792-ac84-47be-acd8-a03d94abf2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:13.560719 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73043792-ac84-47be-acd8-a03d94abf2f0 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:13.561401 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73043792-ac84-47be-acd8-a03d94abf2f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:13.563477 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73043792-ac84-47be-acd8-a03d94abf2f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:13.563477 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73043792-ac84-47be-acd8-a03d94abf2f0 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:13.576135 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:13.583049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 194/385] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:13.591353 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73043792-ac84-47be-acd8-a03d94abf2f0 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:13.627141 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:13.630366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 192/386] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:36:13.679848 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27aadc-694e-4313-91bf-dfd20113bf7f None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:13.745210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73043792-ac84-47be-acd8-a03d94abf2f0 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:13.808932 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce40a00-b4c8-49ae-8a02-cef7af0ad9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:13.809572 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce40a00-b4c8-49ae-8a02-cef7af0ad9dd None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:13.809892 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce40a00-b4c8-49ae-8a02-cef7af0ad9dd None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:13.810105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce40a00-b4c8-49ae-8a02-cef7af0ad9dd None admin] PATH_INFO: `/v3/groups/6c51d8f824eb413b9963e0421eecd614` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:13.811737 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce40a00-b4c8-49ae-8a02-cef7af0ad9dd None admin] RBAC: Authorizing `identity:get_group(group_id=6c51d8f824eb413b9963e0421eecd614)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:13.813282 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce40a00-b4c8-49ae-8a02-cef7af0ad9dd None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:13.815163 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 195/387] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Aug 6 20:36:13 2022] GET /identity/v3/groups/6c51d8f824eb413b9963e0421eecd614 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:13.821108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce40a00-b4c8-49ae-8a02-cef7af0ad9dd None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:13.862224 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27aadc-694e-4313-91bf-dfd20113bf7f None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:13.932871 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab8967-87ca-4837-be7d-87da61cfa9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:13.933510 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab8967-87ca-4837-be7d-87da61cfa9d2 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:13.933783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab8967-87ca-4837-be7d-87da61cfa9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:13.934044 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab8967-87ca-4837-be7d-87da61cfa9d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:13.952902 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab8967-87ca-4837-be7d-87da61cfa9d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-9aab8967-87ca-4837-be7d-87da61cfa9d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:13.957616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:13.958468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:13.959267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:13.959267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:13.959267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:13.959267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:13.959267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:13.959267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:13.959267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:13.959267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:13.959267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:13.959267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:13.959267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:13.959267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:13.959267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 193/388] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:13.966891 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab8967-87ca-4837-be7d-87da61cfa9d2 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:13.967066 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:13.991194 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce40a00-b4c8-49ae-8a02-cef7af0ad9dd None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:14.033915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:14.056288 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387a2e6-04a7-4ecc-858a-f60cb1b8b88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:14.057264 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387a2e6-04a7-4ecc-858a-f60cb1b8b88d None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:14.057718 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387a2e6-04a7-4ecc-858a-f60cb1b8b88d None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:14.058149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387a2e6-04a7-4ecc-858a-f60cb1b8b88d None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:14.060264 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387a2e6-04a7-4ecc-858a-f60cb1b8b88d None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:14.061878 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387a2e6-04a7-4ecc-858a-f60cb1b8b88d None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:14.067027 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 196/389] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:13 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:14.074071 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387a2e6-04a7-4ecc-858a-f60cb1b8b88d None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:14.153781 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab8967-87ca-4837-be7d-87da61cfa9d2 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:14.194895 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da65fc4-677b-4d60-beb6-606cd795c6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:14.196007 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da65fc4-677b-4d60-beb6-606cd795c6c9 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:14.196449 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da65fc4-677b-4d60-beb6-606cd795c6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:14.197301 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da65fc4-677b-4d60-beb6-606cd795c6c9 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:14.198486 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da65fc4-677b-4d60-beb6-606cd795c6c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:14.199541 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da65fc4-677b-4d60-beb6-606cd795c6c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:14.201103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da65fc4-677b-4d60-beb6-606cd795c6c9 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:14.211243 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 194/390] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:36:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:14.220679 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da65fc4-677b-4d60-beb6-606cd795c6c9 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:14.241924 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387a2e6-04a7-4ecc-858a-f60cb1b8b88d None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:14.293383 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b64923-28ef-4868-a4e9-191d74dc86c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:14.294427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b64923-28ef-4868-a4e9-191d74dc86c6 None admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:14.294942 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b64923-28ef-4868-a4e9-191d74dc86c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:14.295415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b64923-28ef-4868-a4e9-191d74dc86c6 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849/groups/6c51d8f824eb413b9963e0421eecd614/roles/273b4b42102c497baaeced73ebb2ba7f` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:14.297794 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b64923-28ef-4868-a4e9-191d74dc86c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c120cb6ccb334c1787bda6da7e12c849, group_id=6c51d8f824eb413b9963e0421eecd614, role_id=273b4b42102c497baaeced73ebb2ba7f)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:14.299506 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b64923-28ef-4868-a4e9-191d74dc86c6 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:14.339651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 197/391] 10.222.0.36 () {58 vars in 1442 bytes} [Sat Aug 6 20:36:14 2022] PUT /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849/groups/6c51d8f824eb413b9963e0421eecd614/roles/273b4b42102c497baaeced73ebb2ba7f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:36:14.372835 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da65fc4-677b-4d60-beb6-606cd795c6c9 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:14.381478 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:14.412665 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28c9d3-7112-4066-a200-dac6832dc182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:14.413372 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c9d3-7112-4066-a200-dac6832dc182 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:14.413657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c9d3-7112-4066-a200-dac6832dc182 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:14.413917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c9d3-7112-4066-a200-dac6832dc182 None admin] PATH_INFO: `/v3/groups/6c51d8f824eb413b9963e0421eecd614` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:14.415564 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28c9d3-7112-4066-a200-dac6832dc182 None admin] RBAC: Authorizing `identity:get_group(group_id=6c51d8f824eb413b9963e0421eecd614)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:14.417083 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28c9d3-7112-4066-a200-dac6832dc182 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:14.419035 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 195/392] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Aug 6 20:36:14 2022] GET /identity/v3/groups/6c51d8f824eb413b9963e0421eecd614 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:14.427135 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b64923-28ef-4868-a4e9-191d74dc86c6 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:14.454824 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:14.586764 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b64923-28ef-4868-a4e9-191d74dc86c6 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:14.628409 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8488bb-5086-4d1b-a460-6a9f1e1884e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:14.628975 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8488bb-5086-4d1b-a460-6a9f1e1884e9 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:14.629246 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8488bb-5086-4d1b-a460-6a9f1e1884e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:14.629513 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8488bb-5086-4d1b-a460-6a9f1e1884e9 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:14.630678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8488bb-5086-4d1b-a460-6a9f1e1884e9 None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:14.632133 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8488bb-5086-4d1b-a460-6a9f1e1884e9 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:14.634266 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 198/393] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:14 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:14.640236 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28c9d3-7112-4066-a200-dac6832dc182 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:14.760918 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28c9d3-7112-4066-a200-dac6832dc182 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:14.796925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fa252-45ff-493e-9b91-17c75eba9ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:14.797600 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fa252-45ff-493e-9b91-17c75eba9ef3 None admin] REQUEST_METHOD: `PUT` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:14.797878 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fa252-45ff-493e-9b91-17c75eba9ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:14.798150 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fa252-45ff-493e-9b91-17c75eba9ef3 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849/groups/6c51d8f824eb413b9963e0421eecd614/roles/3b2a5b7c44354447b2bcac96e039c227` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:14.800138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fa252-45ff-493e-9b91-17c75eba9ef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c120cb6ccb334c1787bda6da7e12c849, group_id=6c51d8f824eb413b9963e0421eecd614, role_id=3b2a5b7c44354447b2bcac96e039c227)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:14.801589 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fa252-45ff-493e-9b91-17c75eba9ef3 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:14.818298 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 196/394] 10.222.0.36 () {58 vars in 1442 bytes} [Sat Aug 6 20:36:14 2022] PUT /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849/groups/6c51d8f824eb413b9963e0421eecd614/roles/3b2a5b7c44354447b2bcac96e039c227 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:36:15.625064 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc2d6d-5073-4390-9872-aedef59f2b5c None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:15.625572 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc2d6d-5073-4390-9872-aedef59f2b5c None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:15.625675 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc2d6d-5073-4390-9872-aedef59f2b5c None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:15.627238 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 199/395] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:15.632765 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfcda2-3412-4686-be53-c21bd8e3207f None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:15.633462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfcda2-3412-4686-be53-c21bd8e3207f None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:15.633543 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfcda2-3412-4686-be53-c21bd8e3207f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:15.652504 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-b9cfcda2-3412-4686-be53-c21bd8e3207f None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:15.653703 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-b9cfcda2-3412-4686-be53-c21bd8e3207f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:15.667926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339f77e-59f3-4d71-905f-1af241967ba8 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:15.668226 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339f77e-59f3-4d71-905f-1af241967ba8 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:15.668478 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339f77e-59f3-4d71-905f-1af241967ba8 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:15.669795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 200/396] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:36:15.675740 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1daeaa-bf67-4ed3-ac01-42e42095898d None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:15.676140 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1daeaa-bf67-4ed3-ac01-42e42095898d None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:15.676517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1daeaa-bf67-4ed3-ac01-42e42095898d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:15.678987 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:15.715621 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-de1daeaa-bf67-4ed3-ac01-42e42095898d None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:15.716817 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-de1daeaa-bf67-4ed3-ac01-42e42095898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:15.734137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 197/397] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:15.780623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfcda2-3412-4686-be53-c21bd8e3207f None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:15.841375 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 201/398] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:36:15.873900 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1daeaa-bf67-4ed3-ac01-42e42095898d None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:15.895034 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:15.969745 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfcda2-3412-4686-be53-c21bd8e3207f None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:16.033198 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2a94c-d0c1-4434-9655-8f2333c2e7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:16.034075 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2a94c-d0c1-4434-9655-8f2333c2e7c0 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:16.034643 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2a94c-d0c1-4434-9655-8f2333c2e7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:16.034927 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2a94c-d0c1-4434-9655-8f2333c2e7c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:16.039278 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1daeaa-bf67-4ed3-ac01-42e42095898d None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:16.055868 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2a94c-d0c1-4434-9655-8f2333c2e7c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-f7a2a94c-d0c1-4434-9655-8f2333c2e7c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:16.062160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:16.063077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:16.064002 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:16.064002 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:16.064002 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:16.064002 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:16.064002 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:16.064002 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:16.064002 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:16.064002 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:16.064002 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:16.064002 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:16.064002 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:16.064002 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:16.064679 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 198/399] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:16.071619 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2a94c-d0c1-4434-9655-8f2333c2e7c0 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:16.081438 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d677e8-4910-40c9-a035-c9941fe615da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:16.082136 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d677e8-4910-40c9-a035-c9941fe615da None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:16.082415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d677e8-4910-40c9-a035-c9941fe615da None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:16.082717 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d677e8-4910-40c9-a035-c9941fe615da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:16.094615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d677e8-4910-40c9-a035-c9941fe615da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-15d677e8-4910-40c9-a035-c9941fe615da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:16.099517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:16.100434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:16.102151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:16.102151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:16.102151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:16.102151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:16.102151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:16.102151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:16.102151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:16.102151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:16.102151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:16.102151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:16.102151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:36:16.102151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:16.102151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 202/400] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:36:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:16.107697 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d677e8-4910-40c9-a035-c9941fe615da None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:16.108082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:16.191425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:16.222829 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d677e8-4910-40c9-a035-c9941fe615da None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:16.258009 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f70efd-308e-43ee-894c-2cb2b013cf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:16.258633 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f70efd-308e-43ee-894c-2cb2b013cf66 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:16.258913 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f70efd-308e-43ee-894c-2cb2b013cf66 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:16.259178 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f70efd-308e-43ee-894c-2cb2b013cf66 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:16.259839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f70efd-308e-43ee-894c-2cb2b013cf66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:16.260140 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f70efd-308e-43ee-894c-2cb2b013cf66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:16.261577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f70efd-308e-43ee-894c-2cb2b013cf66 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:16.270147 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 203/401] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:16.277390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2a94c-d0c1-4434-9655-8f2333c2e7c0 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:16.285126 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f70efd-308e-43ee-894c-2cb2b013cf66 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:16.315716 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa0bad-44d4-4525-9cfb-88556336a4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:16.316477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa0bad-44d4-4525-9cfb-88556336a4ec None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:16.316754 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa0bad-44d4-4525-9cfb-88556336a4ec None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:16.317328 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa0bad-44d4-4525-9cfb-88556336a4ec None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:16.318265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa0bad-44d4-4525-9cfb-88556336a4ec None admin] RBAC: Adding query filter params (name=member) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:16.318566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa0bad-44d4-4525-9cfb-88556336a4ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:16.320622 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa0bad-44d4-4525-9cfb-88556336a4ec None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:16.330889 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 199/402] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:36:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:16.332491 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c3e2a-8ffc-4be9-a7d3-0f3850ae8bd7 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:16.332774 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c3e2a-8ffc-4be9-a7d3-0f3850ae8bd7 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:16.333173 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c3e2a-8ffc-4be9-a7d3-0f3850ae8bd7 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:16.334859 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 200/403] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:16.337318 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c3e2a-8ffc-4be9-a7d3-0f3850ae8bd7 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:16.391234 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f70efd-308e-43ee-894c-2cb2b013cf66 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:16.422052 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:16.427586 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d7c35-ba78-4e33-8ddb-7ec61ea86bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:16.428270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d7c35-ba78-4e33-8ddb-7ec61ea86bef None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:16.429804 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d7c35-ba78-4e33-8ddb-7ec61ea86bef None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:16.429804 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d7c35-ba78-4e33-8ddb-7ec61ea86bef None admin] PATH_INFO: `/v3/groups/6c51d8f824eb413b9963e0421eecd614` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:16.430243 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d7c35-ba78-4e33-8ddb-7ec61ea86bef None admin] RBAC: Authorizing `identity:get_group(group_id=6c51d8f824eb413b9963e0421eecd614)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:16.431801 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d7c35-ba78-4e33-8ddb-7ec61ea86bef None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:16.433730 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 204/404] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Aug 6 20:36:16 2022] GET /identity/v3/groups/6c51d8f824eb413b9963e0421eecd614 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:16.435886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7eda76-8819-4b33-8779-d25850e7410f None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:16.436165 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7eda76-8819-4b33-8779-d25850e7410f None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:16.436437 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7eda76-8819-4b33-8779-d25850e7410f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:16.454960 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:16.455140 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-df7eda76-8819-4b33-8779-d25850e7410f None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:16.456266 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-df7eda76-8819-4b33-8779-d25850e7410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:16.467266 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c3e2a-8ffc-4be9-a7d3-0f3850ae8bd7 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:16.516583 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaaa772-4f8b-4db8-b063-5e3432d4c7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:16.517316 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaa772-4f8b-4db8-b063-5e3432d4c7cd None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:16.518113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaa772-4f8b-4db8-b063-5e3432d4c7cd None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:16.518466 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaa772-4f8b-4db8-b063-5e3432d4c7cd None admin] PATH_INFO: `/v3/groups/6c51d8f824eb413b9963e0421eecd614` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:16.519960 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaaa772-4f8b-4db8-b063-5e3432d4c7cd None admin] RBAC: Authorizing `identity:get_group(group_id=6c51d8f824eb413b9963e0421eecd614)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:16.522209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaaa772-4f8b-4db8-b063-5e3432d4c7cd None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:16.524246 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 201/405] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Aug 6 20:36:16 2022] GET /identity/v3/groups/6c51d8f824eb413b9963e0421eecd614 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:16.525149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaaa772-4f8b-4db8-b063-5e3432d4c7cd None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:16.554712 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 205/406] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:16.554712 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7eda76-8819-4b33-8779-d25850e7410f None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:16.668517 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaaa772-4f8b-4db8-b063-5e3432d4c7cd None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:16.674229 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7eda76-8819-4b33-8779-d25850e7410f None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:16.705368 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe52e8-ab10-4f5d-b053-64c2e68aacb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:16.706101 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:16.706969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe52e8-ab10-4f5d-b053-64c2e68aacb5 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:16.707393 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe52e8-ab10-4f5d-b053-64c2e68aacb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:16.708081 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe52e8-ab10-4f5d-b053-64c2e68aacb5 None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:16.709662 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe52e8-ab10-4f5d-b053-64c2e68aacb5 None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:16.711438 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe52e8-ab10-4f5d-b053-64c2e68aacb5 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:16.713557 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 202/407] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:16 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:16.713674 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751efc76-d4c8-4291-90d6-0b6f9e67ac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:16.714628 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751efc76-d4c8-4291-90d6-0b6f9e67ac9a None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:16.714839 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe52e8-ab10-4f5d-b053-64c2e68aacb5 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:16.714955 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751efc76-d4c8-4291-90d6-0b6f9e67ac9a None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:16.715230 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751efc76-d4c8-4291-90d6-0b6f9e67ac9a None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:16.716361 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751efc76-d4c8-4291-90d6-0b6f9e67ac9a None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:16.717852 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751efc76-d4c8-4291-90d6-0b6f9e67ac9a None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:16.725264 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 206/408] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:16 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:16.725854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751efc76-d4c8-4291-90d6-0b6f9e67ac9a None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:16.737925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:16.836969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751efc76-d4c8-4291-90d6-0b6f9e67ac9a None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:16.843586 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe52e8-ab10-4f5d-b053-64c2e68aacb5 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:16.882278 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e008f-c8c5-49df-a4fc-87985ce556f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:16.883490 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e008f-c8c5-49df-a4fc-87985ce556f1 None admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:16.883934 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e008f-c8c5-49df-a4fc-87985ce556f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:16.884345 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e008f-c8c5-49df-a4fc-87985ce556f1 None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf/groups/6c51d8f824eb413b9963e0421eecd614/roles/273b4b42102c497baaeced73ebb2ba7f` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:16.885635 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd88a7-ea15-467e-bb3e-a9e03640a422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:16.886354 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd88a7-ea15-467e-bb3e-a9e03640a422 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:16.886802 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd88a7-ea15-467e-bb3e-a9e03640a422 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:16.887136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd88a7-ea15-467e-bb3e-a9e03640a422 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:16.887446 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e008f-c8c5-49df-a4fc-87985ce556f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc297353000a4a698d3362cde7e2f1bf, group_id=6c51d8f824eb413b9963e0421eecd614, role_id=273b4b42102c497baaeced73ebb2ba7f)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:16.889120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e008f-c8c5-49df-a4fc-87985ce556f1 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:16.898865 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd88a7-ea15-467e-bb3e-a9e03640a422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-87dd88a7-ea15-467e-bb3e-a9e03640a422 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:16.904250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:16.905614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:16.906761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:16.906761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:16.906761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:16.906761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:16.906761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:16.906761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:16.906761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:16.906761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:16.906761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:16.906761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:16.906761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:36:16.906761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:16.909937 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 207/409] 10.222.0.36 () {58 vars in 1442 bytes} [Sat Aug 6 20:36:16 2022] PUT /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf/groups/6c51d8f824eb413b9963e0421eecd614/roles/273b4b42102c497baaeced73ebb2ba7f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:36:16.911014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e008f-c8c5-49df-a4fc-87985ce556f1 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:16.911940 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 203/410] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:36:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:16.912833 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd88a7-ea15-467e-bb3e-a9e03640a422 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:16.992292 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:17.049409 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:17.051774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e008f-c8c5-49df-a4fc-87985ce556f1 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:17.096391 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cee598-90ba-4ce2-870a-526f1ec37f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:17.097771 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cee598-90ba-4ce2-870a-526f1ec37f02 None admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:17.098216 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cee598-90ba-4ce2-870a-526f1ec37f02 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:17.098800 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cee598-90ba-4ce2-870a-526f1ec37f02 None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf/groups/6c51d8f824eb413b9963e0421eecd614/roles/3b2a5b7c44354447b2bcac96e039c227` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:17.101037 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cee598-90ba-4ce2-870a-526f1ec37f02 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc297353000a4a698d3362cde7e2f1bf, group_id=6c51d8f824eb413b9963e0421eecd614, role_id=3b2a5b7c44354447b2bcac96e039c227)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:17.102994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cee598-90ba-4ce2-870a-526f1ec37f02 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:17.111442 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd88a7-ea15-467e-bb3e-a9e03640a422 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:17.122752 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 208/411] 10.222.0.36 () {58 vars in 1442 bytes} [Sat Aug 6 20:36:16 2022] PUT /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf/groups/6c51d8f824eb413b9963e0421eecd614/roles/3b2a5b7c44354447b2bcac96e039c227 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:36:17.124554 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56c5b6-39d4-4943-a122-9efaa5607a09 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:17.125018 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56c5b6-39d4-4943-a122-9efaa5607a09 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:17.125470 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56c5b6-39d4-4943-a122-9efaa5607a09 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:17.127265 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 209/412] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:17.133567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53cb78-6088-4601-9966-fbe53583ba3d None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:17.134231 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53cb78-6088-4601-9966-fbe53583ba3d None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:17.134738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53cb78-6088-4601-9966-fbe53583ba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:17.155760 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc41983-4816-41c3-b478-da47bb40d821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:17.156449 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41983-4816-41c3-b478-da47bb40d821 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:17.156730 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41983-4816-41c3-b478-da47bb40d821 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:17.157001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41983-4816-41c3-b478-da47bb40d821 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:17.157683 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc41983-4816-41c3-b478-da47bb40d821 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:17.157992 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc41983-4816-41c3-b478-da47bb40d821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:17.158196 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-7f53cb78-6088-4601-9966-fbe53583ba3d None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:17.159533 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc41983-4816-41c3-b478-da47bb40d821 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:17.159926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-7f53cb78-6088-4601-9966-fbe53583ba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:17.169983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 204/413] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:17.175604 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc41983-4816-41c3-b478-da47bb40d821 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:17.241864 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 210/414] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:17.268973 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53cb78-6088-4601-9966-fbe53583ba3d None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:17.303484 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc41983-4816-41c3-b478-da47bb40d821 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:17.329178 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:17.358875 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f6a54-d890-4c47-87d3-83e9af1959bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:17.359438 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f6a54-d890-4c47-87d3-83e9af1959bb None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:17.359708 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f6a54-d890-4c47-87d3-83e9af1959bb None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:17.359972 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f6a54-d890-4c47-87d3-83e9af1959bb None admin] PATH_INFO: `/v3/groups/af1bcf72b1154a908ee82dd59a0f17f0` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:17.361916 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f6a54-d890-4c47-87d3-83e9af1959bb None admin] RBAC: Authorizing `identity:get_group(group_id=af1bcf72b1154a908ee82dd59a0f17f0)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:17.363409 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f6a54-d890-4c47-87d3-83e9af1959bb None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:17.368955 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 205/415] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Aug 6 20:36:17 2022] GET /identity/v3/groups/af1bcf72b1154a908ee82dd59a0f17f0 => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:17.370985 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f6a54-d890-4c47-87d3-83e9af1959bb None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:17.374951 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:17.419751 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53cb78-6088-4601-9966-fbe53583ba3d None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:17.465889 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28758d63-a176-48c1-896f-69561d73d15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:17.466530 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28758d63-a176-48c1-896f-69561d73d15d None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:17.466821 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28758d63-a176-48c1-896f-69561d73d15d None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:17.467088 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28758d63-a176-48c1-896f-69561d73d15d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:17.488750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28758d63-a176-48c1-896f-69561d73d15d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-28758d63-a176-48c1-896f-69561d73d15d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:17.494035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:17.494970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:17.495739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:17.495739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:17.495739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:17.495739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:17.495739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:17.495739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:17.495739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:17.495739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:17.495739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:17.495739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:17.495739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:36:17.495739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:17.498300 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 211/416] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:36:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:17.506711 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28758d63-a176-48c1-896f-69561d73d15d None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:17.515423 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f6a54-d890-4c47-87d3-83e9af1959bb None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:17.551830 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558dbf8-b1a1-4ad1-864a-752c4131cecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:17.552954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558dbf8-b1a1-4ad1-864a-752c4131cecb None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:17.553427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558dbf8-b1a1-4ad1-864a-752c4131cecb None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:17.553891 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558dbf8-b1a1-4ad1-864a-752c4131cecb None admin] PATH_INFO: `/v3/projects/42f40b6097a64b0993acc9ebaceea81e` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:17.555340 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558dbf8-b1a1-4ad1-864a-752c4131cecb None admin] RBAC: Authorizing `identity:get_project(project_id=42f40b6097a64b0993acc9ebaceea81e)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:17.557123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558dbf8-b1a1-4ad1-864a-752c4131cecb None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:17.559379 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 206/417] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:17 2022] GET /identity/v3/projects/42f40b6097a64b0993acc9ebaceea81e => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:17.565425 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558dbf8-b1a1-4ad1-864a-752c4131cecb None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:17.611486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28758d63-a176-48c1-896f-69561d73d15d None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:17.621399 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:17.641282 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:17.647099 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b59d4-90c3-4c99-9d65-afb1743903ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:17.647723 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b59d4-90c3-4c99-9d65-afb1743903ab None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:17.647991 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b59d4-90c3-4c99-9d65-afb1743903ab None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:17.648264 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b59d4-90c3-4c99-9d65-afb1743903ab None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:17.649063 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b59d4-90c3-4c99-9d65-afb1743903ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:17.649362 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b59d4-90c3-4c99-9d65-afb1743903ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:17.658346 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b59d4-90c3-4c99-9d65-afb1743903ab None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:17.675245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 212/418] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:17.676240 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558dbf8-b1a1-4ad1-864a-752c4131cecb None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:17.681416 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b59d4-90c3-4c99-9d65-afb1743903ab None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:17.713088 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ac743-f1f1-4078-a352-b4046f9b9ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:17.714233 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ac743-f1f1-4078-a352-b4046f9b9ab1 None admin] REQUEST_METHOD: `PUT` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:17.714750 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ac743-f1f1-4078-a352-b4046f9b9ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:17.715225 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ac743-f1f1-4078-a352-b4046f9b9ab1 None admin] PATH_INFO: `/v3/projects/42f40b6097a64b0993acc9ebaceea81e/groups/af1bcf72b1154a908ee82dd59a0f17f0/roles/e62e78acab6b46f6a866b4980700caae` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:17.717589 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ac743-f1f1-4078-a352-b4046f9b9ab1 None admin] RBAC: Authorizing `identity:create_grant(project_id=42f40b6097a64b0993acc9ebaceea81e, group_id=af1bcf72b1154a908ee82dd59a0f17f0, role_id=e62e78acab6b46f6a866b4980700caae)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:17.719842 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ac743-f1f1-4078-a352-b4046f9b9ab1 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:17.743079 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 207/419] 10.222.0.36 () {58 vars in 1442 bytes} [Sat Aug 6 20:36:17 2022] PUT /identity/v3/projects/42f40b6097a64b0993acc9ebaceea81e/groups/af1bcf72b1154a908ee82dd59a0f17f0/roles/e62e78acab6b46f6a866b4980700caae => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:36:17.858374 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b59d4-90c3-4c99-9d65-afb1743903ab None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:17.894556 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df17f3-67b9-4cd2-bf1b-b52953a191ea None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:17.895207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df17f3-67b9-4cd2-bf1b-b52953a191ea None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:17.895738 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df17f3-67b9-4cd2-bf1b-b52953a191ea None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:17.897626 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 208/420] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:36:17.902221 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028067e2-639b-453b-aaec-7146353d99eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:17.903153 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028067e2-639b-453b-aaec-7146353d99eb None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:17.903153 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028067e2-639b-453b-aaec-7146353d99eb None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:17.903363 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028067e2-639b-453b-aaec-7146353d99eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:17.905440 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f16ef-601b-49cb-b2a6-81a3479e81fa None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:17.905986 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f16ef-601b-49cb-b2a6-81a3479e81fa None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:17.906505 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f16ef-601b-49cb-b2a6-81a3479e81fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:17.926996 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-3c9f16ef-601b-49cb-b2a6-81a3479e81fa None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:17.928630 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-3c9f16ef-601b-49cb-b2a6-81a3479e81fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:18.001814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:18.012753 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 209/421] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:18.044391 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028067e2-639b-453b-aaec-7146353d99eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:18.045883 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028067e2-639b-453b-aaec-7146353d99eb None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:18.060660 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f16ef-601b-49cb-b2a6-81a3479e81fa None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:18.161493 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:18.217920 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f16ef-601b-49cb-b2a6-81a3479e81fa None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:18.233466 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 213/422] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:18.238777 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028067e2-639b-453b-aaec-7146353d99eb None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:18.288992 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca7b81-39e6-4e14-8a0f-2aff023fc50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:18.290616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca7b81-39e6-4e14-8a0f-2aff023fc50e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:18.290904 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca7b81-39e6-4e14-8a0f-2aff023fc50e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:18.291174 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca7b81-39e6-4e14-8a0f-2aff023fc50e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:18.312069 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca7b81-39e6-4e14-8a0f-2aff023fc50e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-07ca7b81-39e6-4e14-8a0f-2aff023fc50e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:18.316734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:18.317625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:18.318394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:18.318394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:18.318394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:18.318394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:18.318394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:18.318394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:18.318394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:18.318394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:18.318394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:18.318394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:18.318394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:18.318394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:18.318394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 210/423] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:18.329975 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca7b81-39e6-4e14-8a0f-2aff023fc50e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:18.375458 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:18.420889 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028067e2-639b-453b-aaec-7146353d99eb None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:18.462631 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3083c7-b5ac-45cd-bac5-c797978b6e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:18.463328 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3083c7-b5ac-45cd-bac5-c797978b6e59 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:18.464233 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3083c7-b5ac-45cd-bac5-c797978b6e59 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:18.464513 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3083c7-b5ac-45cd-bac5-c797978b6e59 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:18.465919 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3083c7-b5ac-45cd-bac5-c797978b6e59 None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:18.468524 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3083c7-b5ac-45cd-bac5-c797978b6e59 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:18.477985 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 214/424] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:18 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:18.483286 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3083c7-b5ac-45cd-bac5-c797978b6e59 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:18.516967 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca7b81-39e6-4e14-8a0f-2aff023fc50e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:18.562139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:18.582738 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e3243-b691-4f5c-a922-c86cda1d3e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:18.584689 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e3243-b691-4f5c-a922-c86cda1d3e1e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:18.587850 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e3243-b691-4f5c-a922-c86cda1d3e1e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:18.588368 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e3243-b691-4f5c-a922-c86cda1d3e1e None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:18.589260 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e3243-b691-4f5c-a922-c86cda1d3e1e None admin] RBAC: Adding query filter params (name=member) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:18.589763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e3243-b691-4f5c-a922-c86cda1d3e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:18.591427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e3243-b691-4f5c-a922-c86cda1d3e1e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:18.614076 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 211/425] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:36:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:18.618886 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e3243-b691-4f5c-a922-c86cda1d3e1e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:18.626378 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3083c7-b5ac-45cd-bac5-c797978b6e59 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:18.670510 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdde0c-1246-4db9-afc2-47a0c3d79576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:18.671685 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdde0c-1246-4db9-afc2-47a0c3d79576 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:18.672152 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdde0c-1246-4db9-afc2-47a0c3d79576 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:18.672605 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdde0c-1246-4db9-afc2-47a0c3d79576 None admin] PATH_INFO: `/v3/groups/6c51d8f824eb413b9963e0421eecd614` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:18.673987 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdde0c-1246-4db9-afc2-47a0c3d79576 None admin] RBAC: Authorizing `identity:get_group(group_id=6c51d8f824eb413b9963e0421eecd614)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:18.676793 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdde0c-1246-4db9-afc2-47a0c3d79576 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:18.679495 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 215/426] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Aug 6 20:36:18 2022] GET /identity/v3/groups/6c51d8f824eb413b9963e0421eecd614 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:18.685286 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdde0c-1246-4db9-afc2-47a0c3d79576 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:18.702947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:18.758433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e3243-b691-4f5c-a922-c86cda1d3e1e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:18.793919 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97daf42-dbb2-4844-ad80-61c91a0856fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:18.794523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97daf42-dbb2-4844-ad80-61c91a0856fa None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:18.794842 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97daf42-dbb2-4844-ad80-61c91a0856fa None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:18.795107 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97daf42-dbb2-4844-ad80-61c91a0856fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:18.853078 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:18.871775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97daf42-dbb2-4844-ad80-61c91a0856fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:18.873402 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97daf42-dbb2-4844-ad80-61c91a0856fa None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:18.945071 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdde0c-1246-4db9-afc2-47a0c3d79576 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:18.986529 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 212/427] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:18.991628 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97daf42-dbb2-4844-ad80-61c91a0856fa None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:19.009378 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad602906-d34e-43ba-8619-5a2bd030ceb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:19.010039 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad602906-d34e-43ba-8619-5a2bd030ceb7 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:19.010314 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad602906-d34e-43ba-8619-5a2bd030ceb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:19.010594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad602906-d34e-43ba-8619-5a2bd030ceb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:19.011327 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad602906-d34e-43ba-8619-5a2bd030ceb7 None admin] RBAC: Adding query filter params (group.id=6c51d8f824eb413b9963e0421eecd614, role.id=273b4b42102c497baaeced73ebb2ba7f, scope.project.id=c120cb6ccb334c1787bda6da7e12c849) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:19.011628 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad602906-d34e-43ba-8619-5a2bd030ceb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:19.013047 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad602906-d34e-43ba-8619-5a2bd030ceb7 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:19.023173 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 216/428] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Aug 6 20:36:18 2022] GET /identity/v3/role_assignments?group.id=6c51d8f824eb413b9963e0421eecd614&scope.project.id=c120cb6ccb334c1787bda6da7e12c849&role.id=273b4b42102c497baaeced73ebb2ba7f => generated 611 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:19.093806 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:19.111901 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97daf42-dbb2-4844-ad80-61c91a0856fa None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:19.152663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aecb7c-07c0-43a9-a6aa-8c2860e6e718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:19.153321 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aecb7c-07c0-43a9-a6aa-8c2860e6e718 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:19.153592 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aecb7c-07c0-43a9-a6aa-8c2860e6e718 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:19.153856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aecb7c-07c0-43a9-a6aa-8c2860e6e718 None admin] PATH_INFO: `/v3/projects/c120cb6ccb334c1787bda6da7e12c849` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:19.155042 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aecb7c-07c0-43a9-a6aa-8c2860e6e718 None admin] RBAC: Authorizing `identity:get_project(project_id=c120cb6ccb334c1787bda6da7e12c849)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:19.156579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aecb7c-07c0-43a9-a6aa-8c2860e6e718 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:19.158236 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 213/429] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:18 2022] GET /identity/v3/projects/c120cb6ccb334c1787bda6da7e12c849 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:19.164094 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad602906-d34e-43ba-8619-5a2bd030ceb7 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:19.270673 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:19.314605 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad602906-d34e-43ba-8619-5a2bd030ceb7 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:19.357125 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c583e2-7012-4ae0-992f-7ec149c355c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:19.357772 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c583e2-7012-4ae0-992f-7ec149c355c6 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:19.358042 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c583e2-7012-4ae0-992f-7ec149c355c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:19.358307 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c583e2-7012-4ae0-992f-7ec149c355c6 None admin] PATH_INFO: `/v3/groups/6c51d8f824eb413b9963e0421eecd614` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:19.359422 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c583e2-7012-4ae0-992f-7ec149c355c6 None admin] RBAC: Authorizing `identity:get_group(group_id=6c51d8f824eb413b9963e0421eecd614)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:19.360853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c583e2-7012-4ae0-992f-7ec149c355c6 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:19.362742 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 217/430] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Aug 6 20:36:19 2022] GET /identity/v3/groups/6c51d8f824eb413b9963e0421eecd614 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:19.368740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aecb7c-07c0-43a9-a6aa-8c2860e6e718 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:19.484159 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aecb7c-07c0-43a9-a6aa-8c2860e6e718 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:19.518440 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717ea00-f50c-4cb7-882b-33a239b0a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:19.519078 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717ea00-f50c-4cb7-882b-33a239b0a1f5 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:19.519348 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717ea00-f50c-4cb7-882b-33a239b0a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:19.519610 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717ea00-f50c-4cb7-882b-33a239b0a1f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:19.520333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717ea00-f50c-4cb7-882b-33a239b0a1f5 None admin] RBAC: Adding query filter params (group.id=6c51d8f824eb413b9963e0421eecd614, role.id=3b2a5b7c44354447b2bcac96e039c227, scope.project.id=c120cb6ccb334c1787bda6da7e12c849) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:19.520632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717ea00-f50c-4cb7-882b-33a239b0a1f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:19.522110 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717ea00-f50c-4cb7-882b-33a239b0a1f5 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:19.528949 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 214/431] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Aug 6 20:36:19 2022] GET /identity/v3/role_assignments?group.id=6c51d8f824eb413b9963e0421eecd614&scope.project.id=c120cb6ccb334c1787bda6da7e12c849&role.id=3b2a5b7c44354447b2bcac96e039c227 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:19.908003 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae1634-9d3f-4c23-83d5-76c34af05a92 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:19.908496 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae1634-9d3f-4c23-83d5-76c34af05a92 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:19.908570 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae1634-9d3f-4c23-83d5-76c34af05a92 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:19.910046 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 218/432] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:19.915888 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f6d91-5ff9-4ff2-ad4a-2c3b365f060f None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:19.916331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f6d91-5ff9-4ff2-ad4a-2c3b365f060f None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:19.916529 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f6d91-5ff9-4ff2-ad4a-2c3b365f060f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:19.937614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-dc4f6d91-5ff9-4ff2-ad4a-2c3b365f060f None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:19.938952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-dc4f6d91-5ff9-4ff2-ad4a-2c3b365f060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:19.940425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b17c1-3073-4de7-aeae-0e4da0ce0a5b None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:19.941169 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b17c1-3073-4de7-aeae-0e4da0ce0a5b None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:19.941663 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b17c1-3073-4de7-aeae-0e4da0ce0a5b None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:19.944640 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 219/433] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:19.953185 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7cdd0-dc33-4606-8ea5-7859c9e626a5 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:19.953544 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:19.954079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7cdd0-dc33-4606-8ea5-7859c9e626a5 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:19.954635 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7cdd0-dc33-4606-8ea5-7859c9e626a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:19.978824 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-51f7cdd0-dc33-4606-8ea5-7859c9e626a5 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:19.980016 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-51f7cdd0-dc33-4606-8ea5-7859c9e626a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:20.030491 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 215/434] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:20.055028 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f6d91-5ff9-4ff2-ad4a-2c3b365f060f None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:20.071977 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 220/435] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:36:20.095869 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7cdd0-dc33-4606-8ea5-7859c9e626a5 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:20.171532 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:20.176722 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f6d91-5ff9-4ff2-ad4a-2c3b365f060f None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:20.217921 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7cdd0-dc33-4606-8ea5-7859c9e626a5 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:20.229787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923f849-903e-46f4-93b4-bd35f5ff45c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:20.230443 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923f849-903e-46f4-93b4-bd35f5ff45c9 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:20.230763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923f849-903e-46f4-93b4-bd35f5ff45c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:20.231035 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923f849-903e-46f4-93b4-bd35f5ff45c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:20.243940 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923f849-903e-46f4-93b4-bd35f5ff45c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-b923f849-903e-46f4-93b4-bd35f5ff45c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:20.248691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:20.249534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:20.251415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:20.251415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:20.251415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:20.251415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:20.251415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:20.251415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:20.251415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:20.251415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:20.251415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:20.251415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:20.251415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:36:20.251415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:20.251415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 216/436] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:36:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:20.255762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923f849-903e-46f4-93b4-bd35f5ff45c9 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:20.261006 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b319aa5-bead-4231-99a7-bd4f929feeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:20.261648 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b319aa5-bead-4231-99a7-bd4f929feeb2 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:20.261926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b319aa5-bead-4231-99a7-bd4f929feeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:20.262189 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b319aa5-bead-4231-99a7-bd4f929feeb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:20.266621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:20.275764 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b319aa5-bead-4231-99a7-bd4f929feeb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-6b319aa5-bead-4231-99a7-bd4f929feeb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:20.282128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:20.283040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:20.283827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:20.283827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:20.283827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:20.283827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:20.283827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:20.283827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:20.283827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:20.283827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:20.283827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:20.283827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:20.283827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:36:20.283827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:20.286810 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 221/437] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:20.289293 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b319aa5-bead-4231-99a7-bd4f929feeb2 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:20.364186 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923f849-903e-46f4-93b4-bd35f5ff45c9 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:20.392565 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b319aa5-bead-4231-99a7-bd4f929feeb2 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:20.398758 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89324d48-1fae-41d7-b91c-07af1e676e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:20.399371 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89324d48-1fae-41d7-b91c-07af1e676e56 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:20.399641 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89324d48-1fae-41d7-b91c-07af1e676e56 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:20.399903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89324d48-1fae-41d7-b91c-07af1e676e56 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:20.400556 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89324d48-1fae-41d7-b91c-07af1e676e56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:20.400852 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89324d48-1fae-41d7-b91c-07af1e676e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:20.402247 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89324d48-1fae-41d7-b91c-07af1e676e56 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:20.410468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 217/438] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:20.411778 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e42a36-3b9e-4eff-99ce-6d3058e9253d None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:20.412060 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e42a36-3b9e-4eff-99ce-6d3058e9253d None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:20.412326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e42a36-3b9e-4eff-99ce-6d3058e9253d None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:20.413477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 218/439] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:20.418969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e42a36-3b9e-4eff-99ce-6d3058e9253d None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:20.424803 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:20.434822 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8911e-aa76-42de-a376-deab734fb87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:20.435439 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8911e-aa76-42de-a376-deab734fb87f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:20.442608 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8911e-aa76-42de-a376-deab734fb87f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:20.442608 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8911e-aa76-42de-a376-deab734fb87f None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:20.442608 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8911e-aa76-42de-a376-deab734fb87f None admin] RBAC: Adding query filter params (name=member) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:20.442608 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8911e-aa76-42de-a376-deab734fb87f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:20.442608 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8911e-aa76-42de-a376-deab734fb87f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:20.447946 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 222/440] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:36:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:20.449100 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373e775-d0e2-4d06-8575-cba828f0d4e5 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:20.449411 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373e775-d0e2-4d06-8575-cba828f0d4e5 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:20.449709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373e775-d0e2-4d06-8575-cba828f0d4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:20.467933 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-5373e775-d0e2-4d06-8575-cba828f0d4e5 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:20.469138 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-5373e775-d0e2-4d06-8575-cba828f0d4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:20.499526 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:20.544857 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e42a36-3b9e-4eff-99ce-6d3058e9253d None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:20.560109 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 223/441] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:20.560846 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373e775-d0e2-4d06-8575-cba828f0d4e5 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:20.587835 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e322f97-178d-499c-bf25-564bcb3d6c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:20.588439 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e322f97-178d-499c-bf25-564bcb3d6c87 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:20.588707 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e322f97-178d-499c-bf25-564bcb3d6c87 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:20.588973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e322f97-178d-499c-bf25-564bcb3d6c87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:20.656298 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e322f97-178d-499c-bf25-564bcb3d6c87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:20.657765 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e322f97-178d-499c-bf25-564bcb3d6c87 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:20.658797 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373e775-d0e2-4d06-8575-cba828f0d4e5 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:20.677741 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:20.691745 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400c98e-c52e-4d23-bb81-b7453ab8de88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:20.692359 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400c98e-c52e-4d23-bb81-b7453ab8de88 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:20.692635 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400c98e-c52e-4d23-bb81-b7453ab8de88 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:20.692904 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400c98e-c52e-4d23-bb81-b7453ab8de88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:20.720841 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:20.755939 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 219/442] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:20.756766 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e322f97-178d-499c-bf25-564bcb3d6c87 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:20.764649 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400c98e-c52e-4d23-bb81-b7453ab8de88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:20.766119 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400c98e-c52e-4d23-bb81-b7453ab8de88 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:20.853773 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e322f97-178d-499c-bf25-564bcb3d6c87 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:20.864784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 224/443] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:20.865621 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400c98e-c52e-4d23-bb81-b7453ab8de88 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:20.887667 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:20.890218 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a0bc9-93c2-4b60-b27f-68efd626a9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:20.890922 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a0bc9-93c2-4b60-b27f-68efd626a9b2 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:20.891337 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a0bc9-93c2-4b60-b27f-68efd626a9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:20.891569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a0bc9-93c2-4b60-b27f-68efd626a9b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:20.903087 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a0bc9-93c2-4b60-b27f-68efd626a9b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-2c5a0bc9-93c2-4b60-b27f-68efd626a9b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:20.907973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:20.908933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:20.909719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:20.909719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:20.909719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:20.909719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:20.909719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:20.909719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:20.909719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:20.909719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:20.909719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:20.909719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:20.909719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:36:20.909719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:20.909719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 220/444] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:36:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:20.910356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a0bc9-93c2-4b60-b27f-68efd626a9b2 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:20.940417 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:20.970198 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400c98e-c52e-4d23-bb81-b7453ab8de88 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:21.004308 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369a40f-4438-4af9-aa4c-1aad02976c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:21.004928 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369a40f-4438-4af9-aa4c-1aad02976c9a None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:21.005203 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369a40f-4438-4af9-aa4c-1aad02976c9a None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:21.005496 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369a40f-4438-4af9-aa4c-1aad02976c9a None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:21.006668 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369a40f-4438-4af9-aa4c-1aad02976c9a None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:21.008187 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369a40f-4438-4af9-aa4c-1aad02976c9a None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:21.009819 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 225/445] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:20 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:21.010571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369a40f-4438-4af9-aa4c-1aad02976c9a None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:21.012379 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a0bc9-93c2-4b60-b27f-68efd626a9b2 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:21.045759 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769e039-d3f1-457b-8a03-1e946d1cbc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:21.046384 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769e039-d3f1-457b-8a03-1e946d1cbc6d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:21.046687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769e039-d3f1-457b-8a03-1e946d1cbc6d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:21.046945 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769e039-d3f1-457b-8a03-1e946d1cbc6d None admin] PATH_INFO: `/v3/projects/dc297353000a4a698d3362cde7e2f1bf` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:21.048074 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769e039-d3f1-457b-8a03-1e946d1cbc6d None admin] RBAC: Authorizing `identity:get_project(project_id=dc297353000a4a698d3362cde7e2f1bf)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:21.049512 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769e039-d3f1-457b-8a03-1e946d1cbc6d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:21.051128 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 221/446] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:20 2022] GET /identity/v3/projects/dc297353000a4a698d3362cde7e2f1bf => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:21.051865 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769e039-d3f1-457b-8a03-1e946d1cbc6d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:21.102857 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:21.115688 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369a40f-4438-4af9-aa4c-1aad02976c9a None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:21.151193 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321942b2-b77b-4a69-94a9-907e3c7458a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:21.151909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321942b2-b77b-4a69-94a9-907e3c7458a4 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:21.152212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321942b2-b77b-4a69-94a9-907e3c7458a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:21.152543 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321942b2-b77b-4a69-94a9-907e3c7458a4 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:21.153206 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321942b2-b77b-4a69-94a9-907e3c7458a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:21.157232 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321942b2-b77b-4a69-94a9-907e3c7458a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:21.157232 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321942b2-b77b-4a69-94a9-907e3c7458a4 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:21.157807 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:21.165134 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769e039-d3f1-457b-8a03-1e946d1cbc6d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:21.165499 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 226/447] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:21.165499 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321942b2-b77b-4a69-94a9-907e3c7458a4 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:21.200867 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3ce46-ed2f-4b37-a6b3-ef14016e88e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:21.201389 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3ce46-ed2f-4b37-a6b3-ef14016e88e1 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:21.201660 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3ce46-ed2f-4b37-a6b3-ef14016e88e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:21.201929 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3ce46-ed2f-4b37-a6b3-ef14016e88e1 None admin] PATH_INFO: `/v3/groups/6c51d8f824eb413b9963e0421eecd614` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:21.203077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3ce46-ed2f-4b37-a6b3-ef14016e88e1 None admin] RBAC: Authorizing `identity:get_group(group_id=6c51d8f824eb413b9963e0421eecd614)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:21.204542 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3ce46-ed2f-4b37-a6b3-ef14016e88e1 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:21.211212 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 222/448] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Aug 6 20:36:21 2022] GET /identity/v3/groups/6c51d8f824eb413b9963e0421eecd614 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:21.211212 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3ce46-ed2f-4b37-a6b3-ef14016e88e1 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:21.267111 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321942b2-b77b-4a69-94a9-907e3c7458a4 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:21.300801 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3503fb-c09e-4e7a-adfd-2d5e2b1ae28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:21.301431 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3503fb-c09e-4e7a-adfd-2d5e2b1ae28f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:21.301706 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3503fb-c09e-4e7a-adfd-2d5e2b1ae28f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:21.301963 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3503fb-c09e-4e7a-adfd-2d5e2b1ae28f None admin] PATH_INFO: `/v3/groups/6c51d8f824eb413b9963e0421eecd614` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:21.303192 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3503fb-c09e-4e7a-adfd-2d5e2b1ae28f None admin] RBAC: Authorizing `identity:get_group(group_id=6c51d8f824eb413b9963e0421eecd614)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:21.304676 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3503fb-c09e-4e7a-adfd-2d5e2b1ae28f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:21.306720 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 227/449] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Aug 6 20:36:21 2022] GET /identity/v3/groups/6c51d8f824eb413b9963e0421eecd614 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:21.307485 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3503fb-c09e-4e7a-adfd-2d5e2b1ae28f None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:21.307676 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3ce46-ed2f-4b37-a6b3-ef14016e88e1 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:21.326525 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:21.346642 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d25971-6d20-4454-ac0a-c63bf99b3374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:21.347257 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d25971-6d20-4454-ac0a-c63bf99b3374 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:21.347530 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d25971-6d20-4454-ac0a-c63bf99b3374 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:21.347799 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d25971-6d20-4454-ac0a-c63bf99b3374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:21.378748 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:21.407555 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3503fb-c09e-4e7a-adfd-2d5e2b1ae28f None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:21.415546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d25971-6d20-4454-ac0a-c63bf99b3374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:21.417043 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d25971-6d20-4454-ac0a-c63bf99b3374 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:21.442288 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53609c-1153-4d09-b1e1-ed2ba9b6328e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:21.442926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53609c-1153-4d09-b1e1-ed2ba9b6328e None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:21.443205 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53609c-1153-4d09-b1e1-ed2ba9b6328e None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:21.443475 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53609c-1153-4d09-b1e1-ed2ba9b6328e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:21.444198 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53609c-1153-4d09-b1e1-ed2ba9b6328e None admin] RBAC: Adding query filter params (group.id=6c51d8f824eb413b9963e0421eecd614, role.id=273b4b42102c497baaeced73ebb2ba7f, scope.project.id=dc297353000a4a698d3362cde7e2f1bf) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:21.444503 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53609c-1153-4d09-b1e1-ed2ba9b6328e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:21.446069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53609c-1153-4d09-b1e1-ed2ba9b6328e None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:21.458720 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 228/450] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Aug 6 20:36:21 2022] GET /identity/v3/role_assignments?group.id=6c51d8f824eb413b9963e0421eecd614&scope.project.id=dc297353000a4a698d3362cde7e2f1bf&role.id=273b4b42102c497baaeced73ebb2ba7f => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:21.458720 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53609c-1153-4d09-b1e1-ed2ba9b6328e None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:21.546630 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 223/451] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:21.552111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d25971-6d20-4454-ac0a-c63bf99b3374 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:21.556861 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:21.578123 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53609c-1153-4d09-b1e1-ed2ba9b6328e None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:21.616554 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d80e5f-144a-4b35-a38c-336bdf504c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:21.617268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d80e5f-144a-4b35-a38c-336bdf504c0d None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:21.617549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d80e5f-144a-4b35-a38c-336bdf504c0d None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:21.617816 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d80e5f-144a-4b35-a38c-336bdf504c0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:21.618553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d80e5f-144a-4b35-a38c-336bdf504c0d None admin] RBAC: Adding query filter params (group.id=6c51d8f824eb413b9963e0421eecd614, role.id=3b2a5b7c44354447b2bcac96e039c227, scope.project.id=dc297353000a4a698d3362cde7e2f1bf) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:21.618896 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d80e5f-144a-4b35-a38c-336bdf504c0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:21.619678 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:21.620351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d80e5f-144a-4b35-a38c-336bdf504c0d None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:21.628268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 229/452] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Aug 6 20:36:21 2022] GET /identity/v3/role_assignments?group.id=6c51d8f824eb413b9963e0421eecd614&scope.project.id=dc297353000a4a698d3362cde7e2f1bf&role.id=3b2a5b7c44354447b2bcac96e039c227 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:21.676671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d25971-6d20-4454-ac0a-c63bf99b3374 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:21.715120 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e5015-ef78-42e1-b753-8363658eeb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:21.715679 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e5015-ef78-42e1-b753-8363658eeb26 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:21.715950 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e5015-ef78-42e1-b753-8363658eeb26 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:21.716219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e5015-ef78-42e1-b753-8363658eeb26 None admin] PATH_INFO: `/v3/projects/42f40b6097a64b0993acc9ebaceea81e` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:21.717379 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e5015-ef78-42e1-b753-8363658eeb26 None admin] RBAC: Authorizing `identity:get_project(project_id=42f40b6097a64b0993acc9ebaceea81e)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:21.718896 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e5015-ef78-42e1-b753-8363658eeb26 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:21.720878 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 224/453] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Aug 6 20:36:21 2022] GET /identity/v3/projects/42f40b6097a64b0993acc9ebaceea81e => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:21.726738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d80e5f-144a-4b35-a38c-336bdf504c0d None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:21.837925 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d80e5f-144a-4b35-a38c-336bdf504c0d None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:21.872791 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a35a8e-e92f-4178-b2a2-a5631fe5410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:21.873481 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35a8e-e92f-4178-b2a2-a5631fe5410a None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:21.873694 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35a8e-e92f-4178-b2a2-a5631fe5410a None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:21.873984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35a8e-e92f-4178-b2a2-a5631fe5410a None admin] PATH_INFO: `/v3/groups/af1bcf72b1154a908ee82dd59a0f17f0` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:21.875149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a35a8e-e92f-4178-b2a2-a5631fe5410a None admin] RBAC: Authorizing `identity:get_group(group_id=af1bcf72b1154a908ee82dd59a0f17f0)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:21.876555 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a35a8e-e92f-4178-b2a2-a5631fe5410a None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:21.878158 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 230/454] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Aug 6 20:36:21 2022] GET /identity/v3/groups/af1bcf72b1154a908ee82dd59a0f17f0 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:21.884771 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e5015-ef78-42e1-b753-8363658eeb26 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:21.988916 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e5015-ef78-42e1-b753-8363658eeb26 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:22.018012 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:22.023729 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d0ef9-ded2-4545-bad5-27dbff06be54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:22.025116 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d0ef9-ded2-4545-bad5-27dbff06be54 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:22.025116 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d0ef9-ded2-4545-bad5-27dbff06be54 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:22.025116 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d0ef9-ded2-4545-bad5-27dbff06be54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:22.025759 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d0ef9-ded2-4545-bad5-27dbff06be54 None admin] RBAC: Adding query filter params (group.id=af1bcf72b1154a908ee82dd59a0f17f0, role.id=e62e78acab6b46f6a866b4980700caae, scope.project.id=42f40b6097a64b0993acc9ebaceea81e) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:22.026186 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d0ef9-ded2-4545-bad5-27dbff06be54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:22.027733 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d0ef9-ded2-4545-bad5-27dbff06be54 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:22.033778 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 225/455] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Aug 6 20:36:21 2022] GET /identity/v3/role_assignments?group.id=af1bcf72b1154a908ee82dd59a0f17f0&scope.project.id=42f40b6097a64b0993acc9ebaceea81e&role.id=e62e78acab6b46f6a866b4980700caae => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:24.548048 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ccaef-11b1-474c-8f22-1122c220fcc6 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:24.549014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ccaef-11b1-474c-8f22-1122c220fcc6 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:24.549484 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ccaef-11b1-474c-8f22-1122c220fcc6 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:24.551618 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 231/456] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:24.558128 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90132c-6790-4d2c-b81c-4a8929ad4a59 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:24.559032 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90132c-6790-4d2c-b81c-4a8929ad4a59 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:24.559517 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90132c-6790-4d2c-b81c-4a8929ad4a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:24.580137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-0b90132c-6790-4d2c-b81c-4a8929ad4a59 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:24.581750 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-0b90132c-6790-4d2c-b81c-4a8929ad4a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:24.656418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 226/457] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:24.682926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ccaef-11b1-474c-8f22-1122c220fcc6 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:24.701034 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:24.745395 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c9d37-7cd4-419e-b0df-ae6a83bd0d6b None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:24.745731 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c9d37-7cd4-419e-b0df-ae6a83bd0d6b None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:24.745933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c9d37-7cd4-419e-b0df-ae6a83bd0d6b None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:24.747539 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 227/458] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:36:24.753419 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b224b-dad6-4f8d-958d-384c807173cb None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:24.753939 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b224b-dad6-4f8d-958d-384c807173cb None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:24.754423 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b224b-dad6-4f8d-958d-384c807173cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:24.772861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-dd3b224b-dad6-4f8d-958d-384c807173cb None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:24.774426 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-dd3b224b-dad6-4f8d-958d-384c807173cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:24.805354 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ccaef-11b1-474c-8f22-1122c220fcc6 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:24.841003 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511f097-200a-4b84-9433-a9651250b9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:24.841650 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511f097-200a-4b84-9433-a9651250b9a8 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:24.841927 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511f097-200a-4b84-9433-a9651250b9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:24.842281 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511f097-200a-4b84-9433-a9651250b9a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:24.848608 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 228/459] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:24.850242 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae4456-59c6-4941-874f-ef82357704f4 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:24.850524 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae4456-59c6-4941-874f-ef82357704f4 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:24.850821 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae4456-59c6-4941-874f-ef82357704f4 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:24.852510 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 229/460] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:24.854694 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511f097-200a-4b84-9433-a9651250b9a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:24.856311 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511f097-200a-4b84-9433-a9651250b9a8 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:24.857394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd086a0-b7c3-4209-b331-8c97d7ec37be None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:24.857670 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd086a0-b7c3-4209-b331-8c97d7ec37be None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:24.857939 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd086a0-b7c3-4209-b331-8c97d7ec37be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-5511f097-200a-4b84-9433-a9651250b9a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:24.874134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:24.875179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:24.876012 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:24.876012 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:24.876012 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:24.876476 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 232/461] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:24.877172 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511f097-200a-4b84-9433-a9651250b9a8 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:24.877663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-bdd086a0-b7c3-4209-b331-8c97d7ec37be None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:24.878865 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-bdd086a0-b7c3-4209-b331-8c97d7ec37be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:24.946163 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:24.959093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:24.965854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 230/462] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:24.966726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd086a0-b7c3-4209-b331-8c97d7ec37be None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:25.002067 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511f097-200a-4b84-9433-a9651250b9a8 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:25.038396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcf178-b922-43d9-85f9-ac0135fab561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:25.039167 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcf178-b922-43d9-85f9-ac0135fab561 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:25.039443 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcf178-b922-43d9-85f9-ac0135fab561 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:25.039898 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcf178-b922-43d9-85f9-ac0135fab561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:25.052251 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fcf178-b922-43d9-85f9-ac0135fab561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:25.053777 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fcf178-b922-43d9-85f9-ac0135fab561 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-f2fcf178-b922-43d9-85f9-ac0135fab561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:25.070396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:25.071575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:25.072399 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:25.072399 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:25.072399 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:25.072399 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 233/463] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:25.072399 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcf178-b922-43d9-85f9-ac0135fab561 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:25.089422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd086a0-b7c3-4209-b331-8c97d7ec37be None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:25.126385 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5aa62-283e-456d-a8d8-7f533657d151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:25.127124 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5aa62-283e-456d-a8d8-7f533657d151 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:25.127445 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5aa62-283e-456d-a8d8-7f533657d151 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:25.127677 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5aa62-283e-456d-a8d8-7f533657d151 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:25.128305 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5aa62-283e-456d-a8d8-7f533657d151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:25.128602 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5aa62-283e-456d-a8d8-7f533657d151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:25.129957 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5aa62-283e-456d-a8d8-7f533657d151 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:25.146069 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 231/464] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:25.146069 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5aa62-283e-456d-a8d8-7f533657d151 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:25.184075 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcf178-b922-43d9-85f9-ac0135fab561 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:25.196788 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:25.202415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:25.225205 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e422cf1-77d2-41e0-8197-0515b13f02de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:25.226193 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e422cf1-77d2-41e0-8197-0515b13f02de None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:25.226713 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e422cf1-77d2-41e0-8197-0515b13f02de None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:25.227153 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e422cf1-77d2-41e0-8197-0515b13f02de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:25.243498 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e422cf1-77d2-41e0-8197-0515b13f02de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:25.245841 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e422cf1-77d2-41e0-8197-0515b13f02de None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-3e422cf1-77d2-41e0-8197-0515b13f02de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:25.263487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:25.264368 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:25.265205 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:25.265205 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:25.265205 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:25.265205 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 234/465] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:25.265205 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e422cf1-77d2-41e0-8197-0515b13f02de None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:25.276532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5aa62-283e-456d-a8d8-7f533657d151 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:25.310250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b0726-d555-4466-b820-9faa50aadd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:25.310872 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b0726-d555-4466-b820-9faa50aadd4d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:25.311157 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b0726-d555-4466-b820-9faa50aadd4d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:25.311421 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b0726-d555-4466-b820-9faa50aadd4d None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:25.312048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b0726-d555-4466-b820-9faa50aadd4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:25.312329 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b0726-d555-4466-b820-9faa50aadd4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:25.313719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b0726-d555-4466-b820-9faa50aadd4d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:25.326925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 232/466] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:25.327925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a400bc0-bee9-4a81-b58a-24afadd48740 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:25.328198 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a400bc0-bee9-4a81-b58a-24afadd48740 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:25.328460 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a400bc0-bee9-4a81-b58a-24afadd48740 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:25.329613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 233/467] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:25.330684 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a400bc0-bee9-4a81-b58a-24afadd48740 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:25.376563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e422cf1-77d2-41e0-8197-0515b13f02de None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:25.409937 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc0677-64e5-40a7-8320-d6608a2448c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:25.410554 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc0677-64e5-40a7-8320-d6608a2448c8 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:25.410861 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc0677-64e5-40a7-8320-d6608a2448c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:25.411124 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc0677-64e5-40a7-8320-d6608a2448c8 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:25.411759 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc0677-64e5-40a7-8320-d6608a2448c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:25.413268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc0677-64e5-40a7-8320-d6608a2448c8 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:25.433632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a400bc0-bee9-4a81-b58a-24afadd48740 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:25.435245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 235/468] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Aug 6 20:36:25 2022] POST /identity/v3/users => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:36:25.436059 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc0677-64e5-40a7-8320-d6608a2448c8 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:25.442357 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:25.468828 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:25.482083 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2015f-9106-41dd-b4a9-48829fa3767a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:25.483055 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2015f-9106-41dd-b4a9-48829fa3767a None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:25.483438 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2015f-9106-41dd-b4a9-48829fa3767a None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:25.484650 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2015f-9106-41dd-b4a9-48829fa3767a None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:25.485417 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2015f-9106-41dd-b4a9-48829fa3767a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:25.485820 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2015f-9106-41dd-b4a9-48829fa3767a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:25.487356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2015f-9106-41dd-b4a9-48829fa3767a None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:25.502001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 234/469] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:25.503329 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf5b60-77e8-48da-8a48-1eeada15466e None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:25.503705 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf5b60-77e8-48da-8a48-1eeada15466e None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:25.504730 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf5b60-77e8-48da-8a48-1eeada15466e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:25.526313 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-bbdf5b60-77e8-48da-8a48-1eeada15466e None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:25.527728 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-bbdf5b60-77e8-48da-8a48-1eeada15466e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:25.567993 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc0677-64e5-40a7-8320-d6608a2448c8 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:25.606692 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 235/470] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:25.608189 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182259c-ccd1-4365-82c4-1f392d141776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:25.608830 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182259c-ccd1-4365-82c4-1f392d141776 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:25.609112 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182259c-ccd1-4365-82c4-1f392d141776 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:25.609378 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182259c-ccd1-4365-82c4-1f392d141776 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:25.609797 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf5b60-77e8-48da-8a48-1eeada15466e None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:25.610038 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182259c-ccd1-4365-82c4-1f392d141776 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:25.611525 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182259c-ccd1-4365-82c4-1f392d141776 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:25.636146 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 236/471] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Aug 6 20:36:25 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:36:25.647770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182259c-ccd1-4365-82c4-1f392d141776 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:25.757187 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:25.763803 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf5b60-77e8-48da-8a48-1eeada15466e None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:25.783102 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:25.803452 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182259c-ccd1-4365-82c4-1f392d141776 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:25.804167 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ba0cc-7100-46d4-87c7-ba1a8728bdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:25.804966 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ba0cc-7100-46d4-87c7-ba1a8728bdab None admin] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:25.805301 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ba0cc-7100-46d4-87c7-ba1a8728bdab None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:25.805584 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ba0cc-7100-46d4-87c7-ba1a8728bdab None admin] PATH_INFO: `/v3/users` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:25.806237 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ba0cc-7100-46d4-87c7-ba1a8728bdab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:25.807794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ba0cc-7100-46d4-87c7-ba1a8728bdab None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:25.835880 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 236/472] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Aug 6 20:36:25 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:36:25.851670 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e344b4-1ac2-467f-bcc3-7182b33b5139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:25.852357 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e344b4-1ac2-467f-bcc3-7182b33b5139 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:25.852628 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e344b4-1ac2-467f-bcc3-7182b33b5139 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:25.852893 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e344b4-1ac2-467f-bcc3-7182b33b5139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:25.867861 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e344b4-1ac2-467f-bcc3-7182b33b5139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:25.869405 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e344b4-1ac2-467f-bcc3-7182b33b5139 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-b0e344b4-1ac2-467f-bcc3-7182b33b5139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:25.889024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:25.889992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:25.890841 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:25.890841 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:25.890841 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:25.899508 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 237/473] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:25.905355 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ba0cc-7100-46d4-87c7-ba1a8728bdab None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:26.028421 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ba0cc-7100-46d4-87c7-ba1a8728bdab None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:26.067550 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031773d-3c09-4483-8ce6-55dff41a2922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:26.068077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031773d-3c09-4483-8ce6-55dff41a2922 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:26.068348 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031773d-3c09-4483-8ce6-55dff41a2922 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:26.068610 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031773d-3c09-4483-8ce6-55dff41a2922 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:26.069251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031773d-3c09-4483-8ce6-55dff41a2922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:26.069546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031773d-3c09-4483-8ce6-55dff41a2922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:26.071074 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031773d-3c09-4483-8ce6-55dff41a2922 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:26.084043 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 237/474] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:26.089829 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e344b4-1ac2-467f-bcc3-7182b33b5139 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:26.195386 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e344b4-1ac2-467f-bcc3-7182b33b5139 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:26.229860 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cd0bf-2039-46a9-9fe1-6b5c75295220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:26.230472 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd0bf-2039-46a9-9fe1-6b5c75295220 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:26.230774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd0bf-2039-46a9-9fe1-6b5c75295220 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:26.231036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd0bf-2039-46a9-9fe1-6b5c75295220 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:26.231683 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cd0bf-2039-46a9-9fe1-6b5c75295220 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:26.233212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cd0bf-2039-46a9-9fe1-6b5c75295220 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:26.241303 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:26.269685 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 238/475] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Aug 6 20:36:26 2022] POST /identity/v3/users => generated 249 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:36:27.844595 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a08900-5953-4c61-a3e4-a4dd56eeb863 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:27.845590 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a08900-5953-4c61-a3e4-a4dd56eeb863 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:27.846078 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a08900-5953-4c61-a3e4-a4dd56eeb863 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:27.847625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 238/476] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:27.853213 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfc91a-83cd-4c22-816e-0d308a1439e5 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:27.853616 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfc91a-83cd-4c22-816e-0d308a1439e5 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:27.853802 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfc91a-83cd-4c22-816e-0d308a1439e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:27.873846 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-90dfc91a-83cd-4c22-816e-0d308a1439e5 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:27.875106 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-90dfc91a-83cd-4c22-816e-0d308a1439e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:27.954356 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 239/477] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:36:27.975528 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a08900-5953-4c61-a3e4-a4dd56eeb863 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:27.993314 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:28.054158 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b8b5b-536e-444a-add8-b0530e402338 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:28.054579 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b8b5b-536e-444a-add8-b0530e402338 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:28.054968 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b8b5b-536e-444a-add8-b0530e402338 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:28.059267 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 240/478] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:28.063407 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df7b39-6c95-4b34-abdf-befa0b6aaad0 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:28.063690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df7b39-6c95-4b34-abdf-befa0b6aaad0 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:28.063961 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df7b39-6c95-4b34-abdf-befa0b6aaad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:28.087539 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-83df7b39-6c95-4b34-abdf-befa0b6aaad0 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:28.088853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-83df7b39-6c95-4b34-abdf-befa0b6aaad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:28.093584 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a08900-5953-4c61-a3e4-a4dd56eeb863 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:28.133968 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eae7c4-e313-4a93-be2b-ab1da9b7a73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:28.135062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eae7c4-e313-4a93-be2b-ab1da9b7a73b None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:28.135544 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eae7c4-e313-4a93-be2b-ab1da9b7a73b None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:28.136008 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eae7c4-e313-4a93-be2b-ab1da9b7a73b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:28.147427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eae7c4-e313-4a93-be2b-ab1da9b7a73b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-b9eae7c4-e313-4a93-be2b-ab1da9b7a73b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:28.153273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:28.154136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:28.154925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:28.154925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:28.154925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:28.154925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:28.154925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:28.154925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:28.154925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:28.154925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:28.154925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:28.154925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:28.154925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:28.154925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:28.157566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 239/479] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:36:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:28.166639 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eae7c4-e313-4a93-be2b-ab1da9b7a73b None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:28.167106 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 241/480] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:28.191604 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df7b39-6c95-4b34-abdf-befa0b6aaad0 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:28.257205 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:28.259822 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:28.297139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eae7c4-e313-4a93-be2b-ab1da9b7a73b None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:28.327340 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df7b39-6c95-4b34-abdf-befa0b6aaad0 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:28.343606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f652600-b5ac-4727-8e54-f61934e9e606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:28.344631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f652600-b5ac-4727-8e54-f61934e9e606 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:28.344911 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f652600-b5ac-4727-8e54-f61934e9e606 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:28.345197 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f652600-b5ac-4727-8e54-f61934e9e606 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:28.345859 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f652600-b5ac-4727-8e54-f61934e9e606 None admin] RBAC: Adding query filter params (name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:28.346276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f652600-b5ac-4727-8e54-f61934e9e606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:28.347798 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f652600-b5ac-4727-8e54-f61934e9e606 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:28.356441 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 240/481] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Aug 6 20:36:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:28.357621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055e016-d85f-45bc-9d65-de352e3a7734 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:28.357893 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055e016-d85f-45bc-9d65-de352e3a7734 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:28.358141 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055e016-d85f-45bc-9d65-de352e3a7734 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:28.359483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 241/482] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:28.362550 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055e016-d85f-45bc-9d65-de352e3a7734 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:28.370169 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37670c47-e123-4010-81b9-db4e90acb4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:28.370932 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37670c47-e123-4010-81b9-db4e90acb4e1 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:28.371275 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37670c47-e123-4010-81b9-db4e90acb4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:28.371615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37670c47-e123-4010-81b9-db4e90acb4e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:28.384706 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37670c47-e123-4010-81b9-db4e90acb4e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-37670c47-e123-4010-81b9-db4e90acb4e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:28.390031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:28.390923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:28.391721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:28.391721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:28.391721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:28.391721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:28.391721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:28.391721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:28.391721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:28.391721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:28.391721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:28.391721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:28.391721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:28.391721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:28.391721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 242/483] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:36:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:28.392352 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea016-c8ee-4399-8013-b9f64e105014 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:28.393017 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea016-c8ee-4399-8013-b9f64e105014 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:28.393017 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea016-c8ee-4399-8013-b9f64e105014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:28.410630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-57fea016-c8ee-4399-8013-b9f64e105014 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:28.411824 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-57fea016-c8ee-4399-8013-b9f64e105014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:28.484320 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 243/484] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:28.485250 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fea016-c8ee-4399-8013-b9f64e105014 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:28.488086 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055e016-d85f-45bc-9d65-de352e3a7734 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:28.530839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:28.531443 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bca0a-c1b9-499c-9f8d-50086870c4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:28.532125 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bca0a-c1b9-499c-9f8d-50086870c4fc None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:28.532369 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bca0a-c1b9-499c-9f8d-50086870c4fc None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:28.532649 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bca0a-c1b9-499c-9f8d-50086870c4fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:28.535169 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:28.546560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bca0a-c1b9-499c-9f8d-50086870c4fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:28.548060 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bca0a-c1b9-499c-9f8d-50086870c4fc None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-ed1bca0a-c1b9-499c-9f8d-50086870c4fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:28.564188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:28.565085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:28.565882 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:28.565882 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:28.565882 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:28.565882 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 242/485] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:28.566531 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bca0a-c1b9-499c-9f8d-50086870c4fc None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:28.600418 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fea016-c8ee-4399-8013-b9f64e105014 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:28.635745 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e409534-8770-4f68-9454-2767d47589c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:28.636277 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e409534-8770-4f68-9454-2767d47589c2 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:28.636555 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e409534-8770-4f68-9454-2767d47589c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:28.636822 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e409534-8770-4f68-9454-2767d47589c2 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:28.637492 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e409534-8770-4f68-9454-2767d47589c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:28.637798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e409534-8770-4f68-9454-2767d47589c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:28.639202 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e409534-8770-4f68-9454-2767d47589c2 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:28.647188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 244/486] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Aug 6 20:36:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:28.651513 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e409534-8770-4f68-9454-2767d47589c2 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:28.679207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bca0a-c1b9-499c-9f8d-50086870c4fc None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:28.712507 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0552b-a2b5-4474-8fc7-bbd413a22801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:28.713137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0552b-a2b5-4474-8fc7-bbd413a22801 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:28.713405 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0552b-a2b5-4474-8fc7-bbd413a22801 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:28.713668 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0552b-a2b5-4474-8fc7-bbd413a22801 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:28.723598 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0552b-a2b5-4474-8fc7-bbd413a22801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-9ea0552b-a2b5-4474-8fc7-bbd413a22801 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:28.728808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:28.729739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:28.730518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:28.730518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:28.730518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:28.730518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:28.730518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:28.730518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:28.730518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:28.730518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:28.730518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:28.730518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:28.730518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:28.730518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:28.730518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 243/487] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:36:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:28.731222 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0552b-a2b5-4474-8fc7-bbd413a22801 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:28.757315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e409534-8770-4f68-9454-2767d47589c2 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:28.759033 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:28.778870 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:28.791958 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06445c36-5049-4923-81d7-8dc3ecad0a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:28.792568 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06445c36-5049-4923-81d7-8dc3ecad0a33 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:28.792846 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06445c36-5049-4923-81d7-8dc3ecad0a33 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:28.793117 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06445c36-5049-4923-81d7-8dc3ecad0a33 None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:28.793755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06445c36-5049-4923-81d7-8dc3ecad0a33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:28.794058 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06445c36-5049-4923-81d7-8dc3ecad0a33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:28.795459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06445c36-5049-4923-81d7-8dc3ecad0a33 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:28.807096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 245/488] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:28.808348 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4c2f0-35e1-44fd-9530-b9ac986ed0f6 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:28.808633 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4c2f0-35e1-44fd-9530-b9ac986ed0f6 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:28.808905 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4c2f0-35e1-44fd-9530-b9ac986ed0f6 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:28.810079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 246/489] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:28.810786 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4c2f0-35e1-44fd-9530-b9ac986ed0f6 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:28.835158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0552b-a2b5-4474-8fc7-bbd413a22801 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:28.868048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15105d48-3f9a-4a10-92b2-617d6832e645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:28.868667 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15105d48-3f9a-4a10-92b2-617d6832e645 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:28.868937 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15105d48-3f9a-4a10-92b2-617d6832e645 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:28.869210 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15105d48-3f9a-4a10-92b2-617d6832e645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:28.880600 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15105d48-3f9a-4a10-92b2-617d6832e645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:28.882065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15105d48-3f9a-4a10-92b2-617d6832e645 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-15105d48-3f9a-4a10-92b2-617d6832e645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:28.897361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:28.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:28.899546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:28.899546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:28.899546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:28.899546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 244/490] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:28.899546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15105d48-3f9a-4a10-92b2-617d6832e645 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:28.916306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4c2f0-35e1-44fd-9530-b9ac986ed0f6 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:28.949536 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfb9c9-cd9f-438a-a478-c58107ee8035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:28.950143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfb9c9-cd9f-438a-a478-c58107ee8035 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:28.950428 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfb9c9-cd9f-438a-a478-c58107ee8035 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:28.950735 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfb9c9-cd9f-438a-a478-c58107ee8035 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:28.951396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfb9c9-cd9f-438a-a478-c58107ee8035 None admin] RBAC: Adding query filter params (name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:28.951697 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfb9c9-cd9f-438a-a478-c58107ee8035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:28.953064 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfb9c9-cd9f-438a-a478-c58107ee8035 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:28.960942 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 247/491] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Aug 6 20:36:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:28.962082 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fe893-fd62-4de6-b14a-cefd88d2bcd9 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:28.962361 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fe893-fd62-4de6-b14a-cefd88d2bcd9 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:28.962656 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fe893-fd62-4de6-b14a-cefd88d2bcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:28.980363 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-092fe893-fd62-4de6-b14a-cefd88d2bcd9 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:28.981549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-092fe893-fd62-4de6-b14a-cefd88d2bcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:28.998418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:28.998938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:29.002153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15105d48-3f9a-4a10-92b2-617d6832e645 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:29.037373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe5eeb-445a-4205-91dd-06a956261436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:29.038002 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe5eeb-445a-4205-91dd-06a956261436 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:29.038281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe5eeb-445a-4205-91dd-06a956261436 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:29.038550 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe5eeb-445a-4205-91dd-06a956261436 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:29.046256 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe5eeb-445a-4205-91dd-06a956261436 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:29.047908 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe5eeb-445a-4205-91dd-06a956261436 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:29.051708 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 248/492] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:29.052552 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fe893-fd62-4de6-b14a-cefd88d2bcd9 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-7ffe5eeb-445a-4205-91dd-06a956261436 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:36:29.061001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:29.062068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:29.062984 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:29.062984 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:29.062984 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:36:29.062984 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:36:29.062984 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:36:29.062984 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:36:29.062984 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:36:29.062984 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:36:29.062984 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:36:29.062984 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:29.062984 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 245/493] 10.222.0.36 () {56 vars in 1093 bytes} [Sat Aug 6 20:36:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:29.063591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe5eeb-445a-4205-91dd-06a956261436 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:29.153197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fe893-fd62-4de6-b14a-cefd88d2bcd9 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:29.165619 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe5eeb-445a-4205-91dd-06a956261436 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:29.187547 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef7986-af94-430f-abcc-1e763f264588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:29.188166 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef7986-af94-430f-abcc-1e763f264588 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:29.188440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef7986-af94-430f-abcc-1e763f264588 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:29.188711 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef7986-af94-430f-abcc-1e763f264588 None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:29.189352 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef7986-af94-430f-abcc-1e763f264588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:29.189654 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef7986-af94-430f-abcc-1e763f264588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:29.191076 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef7986-af94-430f-abcc-1e763f264588 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:29.199047 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093c95e-190e-46f0-ab27-540a7658b718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:29.199670 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093c95e-190e-46f0-ab27-540a7658b718 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:29.200007 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093c95e-190e-46f0-ab27-540a7658b718 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:29.200265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093c95e-190e-46f0-ab27-540a7658b718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:29.202611 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 249/494] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:29.203307 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef7986-af94-430f-abcc-1e763f264588 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:29.216069 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093c95e-190e-46f0-ab27-540a7658b718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:29.217577 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093c95e-190e-46f0-ab27-540a7658b718 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:29.221583 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-8093c95e-190e-46f0-ab27-540a7658b718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:29.231917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:29.232954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:29.233768 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:29.233768 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:29.233768 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:29.233768 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 246/495] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:29.233768 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093c95e-190e-46f0-ab27-540a7658b718 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:29.245933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:29.313233 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef7986-af94-430f-abcc-1e763f264588 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:29.332291 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093c95e-190e-46f0-ab27-540a7658b718 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:29.347652 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bdeb9-a766-4266-bf69-d461ef9c82b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:29.348289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bdeb9-a766-4266-bf69-d461ef9c82b0 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:29.348521 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bdeb9-a766-4266-bf69-d461ef9c82b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:29.348795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bdeb9-a766-4266-bf69-d461ef9c82b0 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:29.349516 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bdeb9-a766-4266-bf69-d461ef9c82b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:29.349821 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bdeb9-a766-4266-bf69-d461ef9c82b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:29.351364 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bdeb9-a766-4266-bf69-d461ef9c82b0 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:29.366147 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952690a-b821-41b2-a043-5dd5ad17b5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:29.366888 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952690a-b821-41b2-a043-5dd5ad17b5e2 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:29.367164 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952690a-b821-41b2-a043-5dd5ad17b5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:29.367431 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952690a-b821-41b2-a043-5dd5ad17b5e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:29.377509 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952690a-b821-41b2-a043-5dd5ad17b5e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-0952690a-b821-41b2-a043-5dd5ad17b5e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:29.382726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:29.383578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:29.384334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:29.384334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:29.384334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:29.384334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:29.384334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:29.384334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:29.384334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:29.384334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:29.384334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:29.384334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:29.384334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:29.384334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:29.384334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 247/496] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:36:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:29.384957 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952690a-b821-41b2-a043-5dd5ad17b5e2 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:29.393033 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 250/497] 10.222.0.36 () {56 vars in 1133 bytes} [Sat Aug 6 20:36:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:29.393938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bdeb9-a766-4266-bf69-d461ef9c82b0 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:29.458357 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:29.463838 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:29.494786 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952690a-b821-41b2-a043-5dd5ad17b5e2 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:29.495190 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bdeb9-a766-4266-bf69-d461ef9c82b0 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:29.528109 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebde1d-e446-4afb-b6c9-b489a53b72a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:29.528707 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a7460-7808-44d5-a9d2-c137cbf6a969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:29.528819 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebde1d-e446-4afb-b6c9-b489a53b72a2 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:29.529027 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebde1d-e446-4afb-b6c9-b489a53b72a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:29.529248 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebde1d-e446-4afb-b6c9-b489a53b72a2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:29.529339 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a7460-7808-44d5-a9d2-c137cbf6a969 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:29.529586 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a7460-7808-44d5-a9d2-c137cbf6a969 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:29.529855 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a7460-7808-44d5-a9d2-c137cbf6a969 None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:29.530497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a7460-7808-44d5-a9d2-c137cbf6a969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:29.530827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a7460-7808-44d5-a9d2-c137cbf6a969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:29.532214 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a7460-7808-44d5-a9d2-c137cbf6a969 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:29.537489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebde1d-e446-4afb-b6c9-b489a53b72a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:29.539168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebde1d-e446-4afb-b6c9-b489a53b72a2 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:29.543313 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 251/498] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:29.544104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a7460-7808-44d5-a9d2-c137cbf6a969 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-65ebde1d-e446-4afb-b6c9-b489a53b72a2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:36:29.550176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:29.551168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:29.552045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:29.552045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:29.552045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:36:29.552045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:36:29.552045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:36:29.552045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:36:29.552045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:36:29.552045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:36:29.552045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:36:29.552045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:29.552045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 248/499] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:29.552045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebde1d-e446-4afb-b6c9-b489a53b72a2 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:29.646200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a7460-7808-44d5-a9d2-c137cbf6a969 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:29.654472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebde1d-e446-4afb-b6c9-b489a53b72a2 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:29.676535 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:29.682558 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfbdb7-6065-45a2-aa22-e13cb2e5876a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:29.683100 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:29.683222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfbdb7-6065-45a2-aa22-e13cb2e5876a None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:29.683681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfbdb7-6065-45a2-aa22-e13cb2e5876a None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:29.683804 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfbdb7-6065-45a2-aa22-e13cb2e5876a None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:29.684433 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfbdb7-6065-45a2-aa22-e13cb2e5876a None admin] RBAC: Adding query filter params (name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:29.684742 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfbdb7-6065-45a2-aa22-e13cb2e5876a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:29.686312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfbdb7-6065-45a2-aa22-e13cb2e5876a None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:29.689315 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bdcf1-3aff-4067-ba3e-781c4c4cf8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:29.689915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bdcf1-3aff-4067-ba3e-781c4c4cf8df None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:29.690190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bdcf1-3aff-4067-ba3e-781c4c4cf8df None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:29.690456 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bdcf1-3aff-4067-ba3e-781c4c4cf8df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:29.694361 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 252/500] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Aug 6 20:36:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:29.695233 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfbdb7-6065-45a2-aa22-e13cb2e5876a None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:29.760149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4bdcf1-3aff-4067-ba3e-781c4c4cf8df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:29.761629 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4bdcf1-3aff-4067-ba3e-781c4c4cf8df None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:29.796781 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfbdb7-6065-45a2-aa22-e13cb2e5876a None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:29.832149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9a425-0480-44cf-836b-cf327252b948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:29.832780 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9a425-0480-44cf-836b-cf327252b948 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:29.833060 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9a425-0480-44cf-836b-cf327252b948 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:29.833328 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9a425-0480-44cf-836b-cf327252b948 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:29.841886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9a425-0480-44cf-836b-cf327252b948 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:29.843366 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9a425-0480-44cf-836b-cf327252b948 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-13b9a425-0480-44cf-836b-cf327252b948 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:36:29.856057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:29.857030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:29.857895 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:29.857895 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:29.857895 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:36:29.857895 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:36:29.857895 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:36:29.857895 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:36:29.857895 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:36:29.857895 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:36:29.857895 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:36:29.857895 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:29.857895 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 253/501] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:29.857895 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9a425-0480-44cf-836b-cf327252b948 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:29.870040 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 249/502] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:29.871215 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bdcf1-3aff-4067-ba3e-781c4c4cf8df None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:29.899389 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:29.914448 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:29.961119 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9a425-0480-44cf-836b-cf327252b948 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:29.967325 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bdcf1-3aff-4067-ba3e-781c4c4cf8df None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:29.995930 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da99f0-9b5c-4aa1-baa9-dc9783d22339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:29.996539 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da99f0-9b5c-4aa1-baa9-dc9783d22339 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:29.996811 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da99f0-9b5c-4aa1-baa9-dc9783d22339 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:29.997071 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da99f0-9b5c-4aa1-baa9-dc9783d22339 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:29.997825 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da99f0-9b5c-4aa1-baa9-dc9783d22339 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:29.998131 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da99f0-9b5c-4aa1-baa9-dc9783d22339 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:29.999621 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da99f0-9b5c-4aa1-baa9-dc9783d22339 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:30.000546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eb45b-2c3a-49ef-8a91-d5ebdc36491e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:30.001141 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eb45b-2c3a-49ef-8a91-d5ebdc36491e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:30.001438 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eb45b-2c3a-49ef-8a91-d5ebdc36491e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:30.001683 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eb45b-2c3a-49ef-8a91-d5ebdc36491e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:30.011807 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303eb45b-2c3a-49ef-8a91-d5ebdc36491e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:30.013168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303eb45b-2c3a-49ef-8a91-d5ebdc36491e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:30.017149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 254/503] 10.222.0.36 () {56 vars in 1137 bytes} [Sat Aug 6 20:36:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:30.018714 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da99f0-9b5c-4aa1-baa9-dc9783d22339 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-303eb45b-2c3a-49ef-8a91-d5ebdc36491e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:30.028034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:30.028903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:30.029974 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:30.029974 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:30.029974 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:30.029974 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 250/504] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:30.030504 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eb45b-2c3a-49ef-8a91-d5ebdc36491e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:30.113461 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:30.123051 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da99f0-9b5c-4aa1-baa9-dc9783d22339 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:30.131057 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eb45b-2c3a-49ef-8a91-d5ebdc36491e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:30.135872 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:30.156694 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff4cdb-41bc-4480-a1a1-5187d7240cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:30.157302 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff4cdb-41bc-4480-a1a1-5187d7240cff None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:30.157570 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff4cdb-41bc-4480-a1a1-5187d7240cff None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:30.157834 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff4cdb-41bc-4480-a1a1-5187d7240cff None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:30.158552 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff4cdb-41bc-4480-a1a1-5187d7240cff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:30.158878 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff4cdb-41bc-4480-a1a1-5187d7240cff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:30.160316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff4cdb-41bc-4480-a1a1-5187d7240cff None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:30.164778 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be551fc4-fcb9-477d-9470-641031dab9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:30.165405 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be551fc4-fcb9-477d-9470-641031dab9b7 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:30.165680 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be551fc4-fcb9-477d-9470-641031dab9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:30.165949 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be551fc4-fcb9-477d-9470-641031dab9b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:30.176232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be551fc4-fcb9-477d-9470-641031dab9b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:30.176917 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 255/505] 10.222.0.36 () {56 vars in 1137 bytes} [Sat Aug 6 20:36:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:30.177691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be551fc4-fcb9-477d-9470-641031dab9b7 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:30.177790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff4cdb-41bc-4480-a1a1-5187d7240cff None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-be551fc4-fcb9-477d-9470-641031dab9b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:30.194234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:30.195624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:30.196636 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:30.196636 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:30.196636 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:30.200665 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 251/506] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:30.201293 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be551fc4-fcb9-477d-9470-641031dab9b7 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:30.282006 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff4cdb-41bc-4480-a1a1-5187d7240cff None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:30.301703 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be551fc4-fcb9-477d-9470-641031dab9b7 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:30.316173 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe79841-fe86-41fb-9db7-ae4831d6e0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:30.316790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe79841-fe86-41fb-9db7-ae4831d6e0b3 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:30.317058 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe79841-fe86-41fb-9db7-ae4831d6e0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:30.317321 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe79841-fe86-41fb-9db7-ae4831d6e0b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:30.335059 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c290c73-f966-46b8-92a5-36a4891056fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:30.335801 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c290c73-f966-46b8-92a5-36a4891056fd None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:30.336086 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c290c73-f966-46b8-92a5-36a4891056fd None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:30.336354 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c290c73-f966-46b8-92a5-36a4891056fd None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:30.336986 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c290c73-f966-46b8-92a5-36a4891056fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:30.337277 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c290c73-f966-46b8-92a5-36a4891056fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:30.338687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c290c73-f966-46b8-92a5-36a4891056fd None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:30.340075 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:30.351865 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 252/507] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:30.352659 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c290c73-f966-46b8-92a5-36a4891056fd None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:30.360450 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:30.389772 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe79841-fe86-41fb-9db7-ae4831d6e0b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:30.391270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe79841-fe86-41fb-9db7-ae4831d6e0b3 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:30.454387 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c290c73-f966-46b8-92a5-36a4891056fd None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:30.489438 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0ab75-d37d-4d08-a71e-9e71fd440318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:30.490047 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0ab75-d37d-4d08-a71e-9e71fd440318 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:30.490320 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0ab75-d37d-4d08-a71e-9e71fd440318 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:30.490618 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0ab75-d37d-4d08-a71e-9e71fd440318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:30.495431 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 256/508] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:30.500160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe79841-fe86-41fb-9db7-ae4831d6e0b3 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:30.551604 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:30.559780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0ab75-d37d-4d08-a71e-9e71fd440318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:30.561262 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0ab75-d37d-4d08-a71e-9e71fd440318 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:30.570759 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:30.602889 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe79841-fe86-41fb-9db7-ae4831d6e0b3 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:30.635861 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9252ca-f683-45ca-9f9a-5fc4e7d20536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:30.636476 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9252ca-f683-45ca-9f9a-5fc4e7d20536 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:30.636741 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9252ca-f683-45ca-9f9a-5fc4e7d20536 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:30.637032 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9252ca-f683-45ca-9f9a-5fc4e7d20536 None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:30.637658 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9252ca-f683-45ca-9f9a-5fc4e7d20536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:30.637956 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9252ca-f683-45ca-9f9a-5fc4e7d20536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:30.639568 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9252ca-f683-45ca-9f9a-5fc4e7d20536 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:30.655320 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 257/509] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:30.655320 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9252ca-f683-45ca-9f9a-5fc4e7d20536 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:30.672557 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 253/510] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:30.673400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0ab75-d37d-4d08-a71e-9e71fd440318 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:30.754114 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9252ca-f683-45ca-9f9a-5fc4e7d20536 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:30.765904 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:30.772595 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0ab75-d37d-4d08-a71e-9e71fd440318 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:30.782374 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:30.789280 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a291d-0693-4463-a1c1-aee0a70154cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:30.789882 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a291d-0693-4463-a1c1-aee0a70154cd None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:30.790154 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a291d-0693-4463-a1c1-aee0a70154cd None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:30.790418 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a291d-0693-4463-a1c1-aee0a70154cd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:30.798561 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a291d-0693-4463-a1c1-aee0a70154cd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:30.800033 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a291d-0693-4463-a1c1-aee0a70154cd None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:30.806579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e152dd-c8f6-476e-a79c-74d347f1a560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:30.807176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e152dd-c8f6-476e-a79c-74d347f1a560 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:30.807449 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e152dd-c8f6-476e-a79c-74d347f1a560 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:30.807717 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e152dd-c8f6-476e-a79c-74d347f1a560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-043a291d-0693-4463-a1c1-aee0a70154cd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:36:30.810774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:30.811703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:30.812559 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:30.812559 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:30.812559 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:36:30.812559 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:36:30.812559 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:36:30.812559 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:36:30.812559 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:36:30.812559 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:36:30.812559 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:36:30.812559 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:30.812559 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 258/511] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:36:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:30.813101 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a291d-0693-4463-a1c1-aee0a70154cd None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:30.817824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e152dd-c8f6-476e-a79c-74d347f1a560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:30.819348 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e152dd-c8f6-476e-a79c-74d347f1a560 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-81e152dd-c8f6-476e-a79c-74d347f1a560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:30.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:30.835265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:30.836206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:30.836206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:30.836206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:30.836206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 254/512] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:30.836826 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e152dd-c8f6-476e-a79c-74d347f1a560 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:30.912396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a291d-0693-4463-a1c1-aee0a70154cd None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:30.939438 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e152dd-c8f6-476e-a79c-74d347f1a560 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:30.946802 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231c9d7-48b9-46c4-8aa9-f455645c43ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:30.947430 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231c9d7-48b9-46c4-8aa9-f455645c43ac None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:30.947701 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231c9d7-48b9-46c4-8aa9-f455645c43ac None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:30.947944 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231c9d7-48b9-46c4-8aa9-f455645c43ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:30.954675 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231c9d7-48b9-46c4-8aa9-f455645c43ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:30.956103 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231c9d7-48b9-46c4-8aa9-f455645c43ac None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:30.967690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-c231c9d7-48b9-46c4-8aa9-f455645c43ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:30.967690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:30.967690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:30.967690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:30.967690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:30.967690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:30.967690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:30.967690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:30.967690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:30.967690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:30.967690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:30.967690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:30.967690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:36:30.967690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:36:30.967690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:30.968984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:30.970442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:36:30.970442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:36:30.970442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:36:30.970442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:36:30.970442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:36:30.970442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:36:30.970442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:30.970442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:30.970442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 259/513] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:30.970442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231c9d7-48b9-46c4-8aa9-f455645c43ac None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:30.979371 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1812c-a739-4a0c-8d01-a72fed4ba35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:30.980008 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1812c-a739-4a0c-8d01-a72fed4ba35d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:30.980279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1812c-a739-4a0c-8d01-a72fed4ba35d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:30.980544 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1812c-a739-4a0c-8d01-a72fed4ba35d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:30.991460 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1812c-a739-4a0c-8d01-a72fed4ba35d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:30.993046 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1812c-a739-4a0c-8d01-a72fed4ba35d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:31.000014 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-b3a1812c-a739-4a0c-8d01-a72fed4ba35d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:31.008783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:31.009732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:31.010552 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:31.010552 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:31.010552 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:31.010552 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 255/514] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:31.010802 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1812c-a739-4a0c-8d01-a72fed4ba35d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:31.023480 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:31.072613 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231c9d7-48b9-46c4-8aa9-f455645c43ac None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:31.105369 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc61bcf-9ec6-4ca2-891e-4621c6dd0fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:31.105968 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc61bcf-9ec6-4ca2-891e-4621c6dd0fef None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:31.106241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc61bcf-9ec6-4ca2-891e-4621c6dd0fef None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:31.106507 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc61bcf-9ec6-4ca2-891e-4621c6dd0fef None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:31.107255 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc61bcf-9ec6-4ca2-891e-4621c6dd0fef None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:31.107556 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc61bcf-9ec6-4ca2-891e-4621c6dd0fef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:31.108972 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc61bcf-9ec6-4ca2-891e-4621c6dd0fef None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:31.109075 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1812c-a739-4a0c-8d01-a72fed4ba35d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:31.125936 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 260/515] 10.222.0.36 () {56 vars in 1139 bytes} [Sat Aug 6 20:36:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:31.126798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc61bcf-9ec6-4ca2-891e-4621c6dd0fef None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:31.144699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf470c0-93a9-4c50-a318-b8c56c056e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:31.145316 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf470c0-93a9-4c50-a318-b8c56c056e70 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:31.145592 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf470c0-93a9-4c50-a318-b8c56c056e70 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:31.145860 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf470c0-93a9-4c50-a318-b8c56c056e70 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:31.146495 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf470c0-93a9-4c50-a318-b8c56c056e70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:31.146844 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf470c0-93a9-4c50-a318-b8c56c056e70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:31.148286 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf470c0-93a9-4c50-a318-b8c56c056e70 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:31.160010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 256/516] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:31.160781 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf470c0-93a9-4c50-a318-b8c56c056e70 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:31.217412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:31.228469 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc61bcf-9ec6-4ca2-891e-4621c6dd0fef None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:31.237513 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:31.257651 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf470c0-93a9-4c50-a318-b8c56c056e70 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:31.262511 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bec62f-30e3-49fd-9d6c-441eadffe223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:31.263153 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bec62f-30e3-49fd-9d6c-441eadffe223 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:31.263430 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bec62f-30e3-49fd-9d6c-441eadffe223 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:31.263698 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bec62f-30e3-49fd-9d6c-441eadffe223 None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:31.264378 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bec62f-30e3-49fd-9d6c-441eadffe223 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:31.264959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bec62f-30e3-49fd-9d6c-441eadffe223 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:31.266099 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bec62f-30e3-49fd-9d6c-441eadffe223 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:31.283639 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 261/517] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:36:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:31.284519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bec62f-30e3-49fd-9d6c-441eadffe223 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:31.293238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815b97e-b25c-4b90-adda-dce10b4e4bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:31.294105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815b97e-b25c-4b90-adda-dce10b4e4bb4 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:31.294381 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815b97e-b25c-4b90-adda-dce10b4e4bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:31.294683 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815b97e-b25c-4b90-adda-dce10b4e4bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:31.295313 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815b97e-b25c-4b90-adda-dce10b4e4bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:31.295616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815b97e-b25c-4b90-adda-dce10b4e4bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:31.296998 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815b97e-b25c-4b90-adda-dce10b4e4bb4 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:31.308386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 257/518] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:31.309233 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815b97e-b25c-4b90-adda-dce10b4e4bb4 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:31.381923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bec62f-30e3-49fd-9d6c-441eadffe223 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:31.407298 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815b97e-b25c-4b90-adda-dce10b4e4bb4 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:31.415273 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8191ab-9d0c-4069-baf5-46d7f4a636c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:31.415860 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8191ab-9d0c-4069-baf5-46d7f4a636c1 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:31.416132 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8191ab-9d0c-4069-baf5-46d7f4a636c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:31.416393 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8191ab-9d0c-4069-baf5-46d7f4a636c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:31.424275 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:31.447085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620c0f2-f484-421b-8b1d-e5f31c2e3bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:31.447727 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620c0f2-f484-421b-8b1d-e5f31c2e3bd1 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:31.448051 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620c0f2-f484-421b-8b1d-e5f31c2e3bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:31.448309 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620c0f2-f484-421b-8b1d-e5f31c2e3bd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:31.453557 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:31.455762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620c0f2-f484-421b-8b1d-e5f31c2e3bd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:31.457233 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620c0f2-f484-421b-8b1d-e5f31c2e3bd1 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:31.470307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-9620c0f2-f484-421b-8b1d-e5f31c2e3bd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:31.470307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:31.470307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:31.470307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:31.470307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:31.470307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:31.470307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:31.470307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:31.470307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:31.470307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:31.470307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:31.470307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:31.470307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:36:31.470307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:36:31.470307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:31.471621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:31.472424 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:36:31.472424 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:36:31.472424 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:36:31.472424 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:36:31.472424 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:36:31.472424 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:36:31.472424 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:31.472424 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:31.474723 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 258/519] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:31.479463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620c0f2-f484-421b-8b1d-e5f31c2e3bd1 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:31.490011 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8191ab-9d0c-4069-baf5-46d7f4a636c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:31.491514 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8191ab-9d0c-4069-baf5-46d7f4a636c1 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:31.582388 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620c0f2-f484-421b-8b1d-e5f31c2e3bd1 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:31.591683 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 262/520] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:31.592519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8191ab-9d0c-4069-baf5-46d7f4a636c1 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:31.617256 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c4261-3eb0-4dca-ba60-28de77abcc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:31.617946 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c4261-3eb0-4dca-ba60-28de77abcc34 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:31.618216 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c4261-3eb0-4dca-ba60-28de77abcc34 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:31.618481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c4261-3eb0-4dca-ba60-28de77abcc34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:31.619302 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c4261-3eb0-4dca-ba60-28de77abcc34 None admin] RBAC: Adding query filter params (role.id=71540591f26d431ba1b1ccb3615c72ea, scope.project.id=ce157732829848e59f95d0cd15a897eb, user.id=9f24d354e53845b2a847fdd12077fe61) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:31.619603 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c4261-3eb0-4dca-ba60-28de77abcc34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:31.621061 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c4261-3eb0-4dca-ba60-28de77abcc34 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:31.626255 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 259/521] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:36:31 2022] GET /identity/v3/role_assignments?user.id=9f24d354e53845b2a847fdd12077fe61&scope.project.id=ce157732829848e59f95d0cd15a897eb&role.id=71540591f26d431ba1b1ccb3615c72ea => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:31.627106 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c4261-3eb0-4dca-ba60-28de77abcc34 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:31.661078 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:31.677274 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:31.698727 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8191ab-9d0c-4069-baf5-46d7f4a636c1 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:31.736645 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f404c5-64f3-4889-912f-da6e086d26f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:31.737250 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f404c5-64f3-4889-912f-da6e086d26f7 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:31.737524 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f404c5-64f3-4889-912f-da6e086d26f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:31.737792 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f404c5-64f3-4889-912f-da6e086d26f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:31.743536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c4261-3eb0-4dca-ba60-28de77abcc34 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:31.745395 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f404c5-64f3-4889-912f-da6e086d26f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:31.746903 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f404c5-64f3-4889-912f-da6e086d26f7 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:31.758909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-39f404c5-64f3-4889-912f-da6e086d26f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:31.758909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:31.758909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:31.758909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:31.758909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:31.758909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:31.758909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:31.758909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:31.758909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:31.758909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:31.758909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:31.758909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:31.758909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:36:31.758909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:36:31.758909 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:31.759826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:31.760657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:36:31.760657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:36:31.760657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:36:31.760657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:36:31.760657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:36:31.760657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:36:31.760657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:31.760657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:31.760657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 263/522] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:31.761081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f404c5-64f3-4889-912f-da6e086d26f7 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:31.789745 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b57ca-fb58-4491-b599-87c99979dc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:31.791180 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b57ca-fb58-4491-b599-87c99979dc70 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:31.791594 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b57ca-fb58-4491-b599-87c99979dc70 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:31.792082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b57ca-fb58-4491-b599-87c99979dc70 None admin] PATH_INFO: `/v3/projects` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:31.793271 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b57ca-fb58-4491-b599-87c99979dc70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:31.793716 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b57ca-fb58-4491-b599-87c99979dc70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:31.796151 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b57ca-fb58-4491-b599-87c99979dc70 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:31.818618 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 260/523] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:36:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:31.819936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b57ca-fb58-4491-b599-87c99979dc70 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:31.874099 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f404c5-64f3-4889-912f-da6e086d26f7 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:31.900869 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:31.909708 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6f8f6-b4a3-4f87-9d15-dae451fdf309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:31.910343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6f8f6-b4a3-4f87-9d15-dae451fdf309 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:31.910643 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6f8f6-b4a3-4f87-9d15-dae451fdf309 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:31.910911 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6f8f6-b4a3-4f87-9d15-dae451fdf309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:31.921950 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6f8f6-b4a3-4f87-9d15-dae451fdf309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:31.923383 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6f8f6-b4a3-4f87-9d15-dae451fdf309 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:31.924708 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b57ca-fb58-4491-b599-87c99979dc70 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:31.926249 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-13d6f8f6-b4a3-4f87-9d15-dae451fdf309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:31.939040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:31.940160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:31.941304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:31.941304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:31.941304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:31.941304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 264/524] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:31.941304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6f8f6-b4a3-4f87-9d15-dae451fdf309 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:31.968989 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5b836-9f2a-41ed-834f-8e43bd8ceff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:31.970016 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5b836-9f2a-41ed-834f-8e43bd8ceff5 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:31.970306 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5b836-9f2a-41ed-834f-8e43bd8ceff5 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:31.970476 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5b836-9f2a-41ed-834f-8e43bd8ceff5 None admin] PATH_INFO: `/v3/projects` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:31.971182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5b836-9f2a-41ed-834f-8e43bd8ceff5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:31.971478 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5b836-9f2a-41ed-834f-8e43bd8ceff5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:31.972978 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5b836-9f2a-41ed-834f-8e43bd8ceff5 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:31.984983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 261/525] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:36:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:31.985794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5b836-9f2a-41ed-834f-8e43bd8ceff5 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:32.051311 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6f8f6-b4a3-4f87-9d15-dae451fdf309 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:32.088725 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5b836-9f2a-41ed-834f-8e43bd8ceff5 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:32.088917 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f70903-9305-423e-9715-1851b2d2e340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:32.089342 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f70903-9305-423e-9715-1851b2d2e340 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:32.089619 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f70903-9305-423e-9715-1851b2d2e340 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:32.089889 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f70903-9305-423e-9715-1851b2d2e340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:32.090650 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f70903-9305-423e-9715-1851b2d2e340 None admin] RBAC: Adding query filter params (role.id=71540591f26d431ba1b1ccb3615c72ea, scope.project.id=ce157732829848e59f95d0cd15a897eb, user.id=b5c55b636efe4fe483c4905af6ca5115) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:32.091667 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f70903-9305-423e-9715-1851b2d2e340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:32.092406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f70903-9305-423e-9715-1851b2d2e340 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:32.106623 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 265/526] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:36:31 2022] GET /identity/v3/role_assignments?user.id=b5c55b636efe4fe483c4905af6ca5115&scope.project.id=ce157732829848e59f95d0cd15a897eb&role.id=71540591f26d431ba1b1ccb3615c72ea => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:32.106623 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f70903-9305-423e-9715-1851b2d2e340 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:32.142609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b859873-18d6-4230-98f9-16b01d90b33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:32.143636 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859873-18d6-4230-98f9-16b01d90b33d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:32.145011 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859873-18d6-4230-98f9-16b01d90b33d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:32.145395 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859873-18d6-4230-98f9-16b01d90b33d None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:32.146142 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b859873-18d6-4230-98f9-16b01d90b33d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:32.146517 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b859873-18d6-4230-98f9-16b01d90b33d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:32.148137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b859873-18d6-4230-98f9-16b01d90b33d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:32.157159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:32.166771 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 262/527] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:32.172975 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b859873-18d6-4230-98f9-16b01d90b33d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:32.205679 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:32.228003 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f70903-9305-423e-9715-1851b2d2e340 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:32.265195 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939681fe-ae64-492b-979c-fd4f5c4a167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:32.265816 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939681fe-ae64-492b-979c-fd4f5c4a167b None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:32.266090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939681fe-ae64-492b-979c-fd4f5c4a167b None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:32.266360 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939681fe-ae64-492b-979c-fd4f5c4a167b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:32.267502 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939681fe-ae64-492b-979c-fd4f5c4a167b None admin] RBAC: Adding query filter params (role.id=71540591f26d431ba1b1ccb3615c72ea, scope.project.id=ce157732829848e59f95d0cd15a897eb, user.id=df2a0a27fb2b48d0b5210f0263639e47) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:32.267502 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939681fe-ae64-492b-979c-fd4f5c4a167b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:32.268890 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939681fe-ae64-492b-979c-fd4f5c4a167b None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:32.281068 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 266/528] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:36:32 2022] GET /identity/v3/role_assignments?user.id=df2a0a27fb2b48d0b5210f0263639e47&scope.project.id=ce157732829848e59f95d0cd15a897eb&role.id=71540591f26d431ba1b1ccb3615c72ea => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:32.301213 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b859873-18d6-4230-98f9-16b01d90b33d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:32.340618 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01ab0d-b5d3-4483-a046-49ff739abf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:32.341620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01ab0d-b5d3-4483-a046-49ff739abf4e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:32.342069 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01ab0d-b5d3-4483-a046-49ff739abf4e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:32.342525 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01ab0d-b5d3-4483-a046-49ff739abf4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:32.351135 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01ab0d-b5d3-4483-a046-49ff739abf4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:32.353661 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01ab0d-b5d3-4483-a046-49ff739abf4e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:32.368366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-bc01ab0d-b5d3-4483-a046-49ff739abf4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:32.368366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:32.368366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:32.368366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:32.368366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:32.368366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:32.368366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:32.368366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:32.368366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:32.368366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:32.368366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:32.368366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:32.368366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:36:32.368366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:36:32.368366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:32.369279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:32.370093 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:36:32.370093 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:36:32.370093 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:36:32.370093 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:36:32.370093 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:36:32.370093 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:36:32.370093 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:32.370093 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:32.372342 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 263/529] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:32.379936 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939681fe-ae64-492b-979c-fd4f5c4a167b None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:32.500388 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939681fe-ae64-492b-979c-fd4f5c4a167b None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:32.510907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:32.537353 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60e630-194b-4e49-9801-8d5bee247200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:32.538241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60e630-194b-4e49-9801-8d5bee247200 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:32.538737 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60e630-194b-4e49-9801-8d5bee247200 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:32.539746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60e630-194b-4e49-9801-8d5bee247200 None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:32.540574 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60e630-194b-4e49-9801-8d5bee247200 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:32.541019 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60e630-194b-4e49-9801-8d5bee247200 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:32.542609 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60e630-194b-4e49-9801-8d5bee247200 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:32.556195 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 267/530] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:32.561836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01ab0d-b5d3-4483-a046-49ff739abf4e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:32.646420 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:32.665682 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01ab0d-b5d3-4483-a046-49ff739abf4e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:32.700580 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a156b0d-f291-4837-89b1-42d6cecc1bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:32.701227 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a156b0d-f291-4837-89b1-42d6cecc1bfb None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:32.701494 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a156b0d-f291-4837-89b1-42d6cecc1bfb None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:32.701761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a156b0d-f291-4837-89b1-42d6cecc1bfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:32.702510 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a156b0d-f291-4837-89b1-42d6cecc1bfb None admin] RBAC: Adding query filter params (role.id=71540591f26d431ba1b1ccb3615c72ea, scope.project.id=ce157732829848e59f95d0cd15a897eb, user.id=471f571c16f9434e924b3a4589340db4) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:32.702843 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a156b0d-f291-4837-89b1-42d6cecc1bfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:32.704265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a156b0d-f291-4837-89b1-42d6cecc1bfb None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:32.710341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 264/531] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:36:32 2022] GET /identity/v3/role_assignments?user.id=471f571c16f9434e924b3a4589340db4&scope.project.id=ce157732829848e59f95d0cd15a897eb&role.id=71540591f26d431ba1b1ccb3615c72ea => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:33.962745 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8910939-1399-4447-88b2-2cac176dc4e1 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:33.963278 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8910939-1399-4447-88b2-2cac176dc4e1 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:33.963278 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8910939-1399-4447-88b2-2cac176dc4e1 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:33.964908 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 268/532] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:33.970804 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8fa4e-dd2d-44c3-be9d-1409840e0d7d None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:33.971217 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8fa4e-dd2d-44c3-be9d-1409840e0d7d None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:33.971387 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8fa4e-dd2d-44c3-be9d-1409840e0d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:33.989569 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-39a8fa4e-dd2d-44c3-be9d-1409840e0d7d None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:33.990783 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-39a8fa4e-dd2d-44c3-be9d-1409840e0d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:34.063604 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 265/533] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:34.083858 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8910939-1399-4447-88b2-2cac176dc4e1 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:34.189531 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8910939-1399-4447-88b2-2cac176dc4e1 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:34.224628 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8026cf6-a832-4bf7-ae36-993476ac1448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:34.225181 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8026cf6-a832-4bf7-ae36-993476ac1448 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:34.225458 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8026cf6-a832-4bf7-ae36-993476ac1448 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:34.225786 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8026cf6-a832-4bf7-ae36-993476ac1448 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:34.240982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8026cf6-a832-4bf7-ae36-993476ac1448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-d8026cf6-a832-4bf7-ae36-993476ac1448 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:34.246396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:34.247306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:34.248110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:34.248110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:34.248110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:34.248110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:34.248110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:34.248110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:34.248110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:34.248110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:34.248110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:34.248110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:34.248110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:34.248110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:34.248110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 269/534] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:36:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:34.253905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8fa4e-dd2d-44c3-be9d-1409840e0d7d None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:34.335518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:34.364318 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8fa4e-dd2d-44c3-be9d-1409840e0d7d None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:34.400197 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fce3e1-dfc0-42c1-a2e2-f05cc4cbfab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:34.401216 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fce3e1-dfc0-42c1-a2e2-f05cc4cbfab6 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:34.401690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fce3e1-dfc0-42c1-a2e2-f05cc4cbfab6 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:34.402155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fce3e1-dfc0-42c1-a2e2-f05cc4cbfab6 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:34.403047 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fce3e1-dfc0-42c1-a2e2-f05cc4cbfab6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:34.403567 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fce3e1-dfc0-42c1-a2e2-f05cc4cbfab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:34.405151 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fce3e1-dfc0-42c1-a2e2-f05cc4cbfab6 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:34.414190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 266/535] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Aug 6 20:36:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:34.419708 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8026cf6-a832-4bf7-ae36-993476ac1448 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:34.452111 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:34.488173 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9d2d2-21ca-474c-ab93-297739805287 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:34.488464 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9d2d2-21ca-474c-ab93-297739805287 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:34.488810 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9d2d2-21ca-474c-ab93-297739805287 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:34.490735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 267/536] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:34.496197 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f3807-b745-4cd2-b0d2-b9f15019d697 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:34.496602 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f3807-b745-4cd2-b0d2-b9f15019d697 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:34.496973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f3807-b745-4cd2-b0d2-b9f15019d697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:34.516197 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-de8f3807-b745-4cd2-b0d2-b9f15019d697 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:34.517528 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-de8f3807-b745-4cd2-b0d2-b9f15019d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:34.534421 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8026cf6-a832-4bf7-ae36-993476ac1448 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:34.574240 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27510b-e5d7-4dd4-a69b-23729ff4e586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:34.575243 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27510b-e5d7-4dd4-a69b-23729ff4e586 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:34.575691 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27510b-e5d7-4dd4-a69b-23729ff4e586 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:34.576128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27510b-e5d7-4dd4-a69b-23729ff4e586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:34.587294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27510b-e5d7-4dd4-a69b-23729ff4e586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:34.589015 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27510b-e5d7-4dd4-a69b-23729ff4e586 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-2a27510b-e5d7-4dd4-a69b-23729ff4e586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:34.605254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:34.606197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:34.607071 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:34.607071 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:34.607071 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:34.609162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 270/538] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:34.609263 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 268/538] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:36:34.614917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f3807-b745-4cd2-b0d2-b9f15019d697 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:34.629714 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a495096-c81c-4e77-bd01-af153a7db51a None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:34.630331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a495096-c81c-4e77-bd01-af153a7db51a None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:34.630822 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a495096-c81c-4e77-bd01-af153a7db51a None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:34.632533 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 271/539] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:36:34.634146 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a495096-c81c-4e77-bd01-af153a7db51a None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:34.686647 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:34.722407 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f3807-b745-4cd2-b0d2-b9f15019d697 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:34.728931 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:34.750181 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a495096-c81c-4e77-bd01-af153a7db51a None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:34.757824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76469ccd-1973-4dbc-820e-0a61f0cf0f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:34.758624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76469ccd-1973-4dbc-820e-0a61f0cf0f26 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:34.758915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76469ccd-1973-4dbc-820e-0a61f0cf0f26 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:34.759188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76469ccd-1973-4dbc-820e-0a61f0cf0f26 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:34.760081 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76469ccd-1973-4dbc-820e-0a61f0cf0f26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:34.760184 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76469ccd-1973-4dbc-820e-0a61f0cf0f26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:34.761508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76469ccd-1973-4dbc-820e-0a61f0cf0f26 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:34.773360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 269/540] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:34.775345 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254987ee-f4e0-4fda-b980-6ff6532564a8 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:34.775830 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254987ee-f4e0-4fda-b980-6ff6532564a8 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:34.776295 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254987ee-f4e0-4fda-b980-6ff6532564a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:34.792858 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9672d6f-c58b-4d5d-bb2d-dc3659f34b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:34.793549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9672d6f-c58b-4d5d-bb2d-dc3659f34b67 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:34.793827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9672d6f-c58b-4d5d-bb2d-dc3659f34b67 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:34.794089 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9672d6f-c58b-4d5d-bb2d-dc3659f34b67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:34.794976 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-254987ee-f4e0-4fda-b980-6ff6532564a8 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:34.796167 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-254987ee-f4e0-4fda-b980-6ff6532564a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:34.810152 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9672d6f-c58b-4d5d-bb2d-dc3659f34b67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-d9672d6f-c58b-4d5d-bb2d-dc3659f34b67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:34.816594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:34.817571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:34.818338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:34.818338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:34.818338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:34.818338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:34.818338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:34.818338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:34.818338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:34.818338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:34.818338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:34.818338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:34.818338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:34.818338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:34.824771 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 272/541] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:36:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:34.824771 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9672d6f-c58b-4d5d-bb2d-dc3659f34b67 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:34.870743 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 270/542] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:34.871949 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254987ee-f4e0-4fda-b980-6ff6532564a8 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:34.941217 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:34.943715 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9672d6f-c58b-4d5d-bb2d-dc3659f34b67 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:34.979247 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc443756-bf53-404c-be2a-0ba2cfa927d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:34.980021 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc443756-bf53-404c-be2a-0ba2cfa927d5 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:34.980130 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc443756-bf53-404c-be2a-0ba2cfa927d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:34.980393 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc443756-bf53-404c-be2a-0ba2cfa927d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:34.985935 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254987ee-f4e0-4fda-b980-6ff6532564a8 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:34.988795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc443756-bf53-404c-be2a-0ba2cfa927d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:34.990370 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc443756-bf53-404c-be2a-0ba2cfa927d5 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:34.993260 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-dc443756-bf53-404c-be2a-0ba2cfa927d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:36:35.003289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:35.004212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:35.005072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:35.005072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:35.005072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:36:35.005072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:36:35.005072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:36:35.005072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:36:35.005072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:36:35.005072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:36:35.005072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:36:35.005072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:35.005072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 273/543] 10.222.0.36 () {56 vars in 1093 bytes} [Sat Aug 6 20:36:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:35.005072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc443756-bf53-404c-be2a-0ba2cfa927d5 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:35.021736 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021a286-05c1-4076-8f88-b626e92d10bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:35.022349 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021a286-05c1-4076-8f88-b626e92d10bb None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:35.022635 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021a286-05c1-4076-8f88-b626e92d10bb None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:35.023033 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021a286-05c1-4076-8f88-b626e92d10bb None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:35.023710 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021a286-05c1-4076-8f88-b626e92d10bb None admin] RBAC: Adding query filter params (name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:35.023983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021a286-05c1-4076-8f88-b626e92d10bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:35.025343 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021a286-05c1-4076-8f88-b626e92d10bb None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:35.032908 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 271/544] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Aug 6 20:36:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:35.034034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cc2da-c4c3-412e-911e-a20cd7527e3a None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:35.034330 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cc2da-c4c3-412e-911e-a20cd7527e3a None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:35.034577 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cc2da-c4c3-412e-911e-a20cd7527e3a None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:35.035747 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 272/545] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:35.036418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cc2da-c4c3-412e-911e-a20cd7527e3a None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:35.108945 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc443756-bf53-404c-be2a-0ba2cfa927d5 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:35.134819 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cc2da-c4c3-412e-911e-a20cd7527e3a None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:35.141540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806e9b7-03fc-4571-8560-c575bc78c21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:35.142162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806e9b7-03fc-4571-8560-c575bc78c21f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:35.142431 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806e9b7-03fc-4571-8560-c575bc78c21f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:35.142727 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806e9b7-03fc-4571-8560-c575bc78c21f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:35.152417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806e9b7-03fc-4571-8560-c575bc78c21f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:35.154272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-a806e9b7-03fc-4571-8560-c575bc78c21f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:35.157427 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:35.158420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:35.159661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:35.159661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:35.159661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:35.159661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:35.159661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:35.159661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:35.159661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:35.159661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:35.159661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:35.159661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:35.159661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:35.159661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:35.159661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 274/546] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:36:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:35.159661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806e9b7-03fc-4571-8560-c575bc78c21f None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:35.171385 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833d952-282b-4c96-9784-2dd84fc3b770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:35.171993 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833d952-282b-4c96-9784-2dd84fc3b770 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:35.172266 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833d952-282b-4c96-9784-2dd84fc3b770 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:35.172532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833d952-282b-4c96-9784-2dd84fc3b770 None admin] PATH_INFO: `/v3/users` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:35.173263 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833d952-282b-4c96-9784-2dd84fc3b770 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:35.173564 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833d952-282b-4c96-9784-2dd84fc3b770 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:35.175025 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833d952-282b-4c96-9784-2dd84fc3b770 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:35.210602 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 273/547] 10.222.0.36 () {56 vars in 1133 bytes} [Sat Aug 6 20:36:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:35.211837 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4b0ee-f395-4fc6-b903-57bb7a21e00b None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:35.212117 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4b0ee-f395-4fc6-b903-57bb7a21e00b None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:35.212386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4b0ee-f395-4fc6-b903-57bb7a21e00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:35.226701 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:35.231142 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-e9d4b0ee-f395-4fc6-b903-57bb7a21e00b None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:35.232345 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-e9d4b0ee-f395-4fc6-b903-57bb7a21e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:35.269164 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806e9b7-03fc-4571-8560-c575bc78c21f None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:35.299071 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 274/548] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:35.299968 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4b0ee-f395-4fc6-b903-57bb7a21e00b None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:35.302180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e086f-7d7a-497d-91e6-617da3cf2fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:35.302868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e086f-7d7a-497d-91e6-617da3cf2fe6 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:35.303144 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e086f-7d7a-497d-91e6-617da3cf2fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:35.303413 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e086f-7d7a-497d-91e6-617da3cf2fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:35.314424 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e086f-7d7a-497d-91e6-617da3cf2fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:35.315897 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e086f-7d7a-497d-91e6-617da3cf2fe6 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-ac5e086f-7d7a-497d-91e6-617da3cf2fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:35.330868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:35.331775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:35.332591 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:35.332591 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:35.332591 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:35.332591 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 275/549] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:35.332811 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e086f-7d7a-497d-91e6-617da3cf2fe6 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:35.399623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4b0ee-f395-4fc6-b903-57bb7a21e00b None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:35.408737 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:35.431817 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e086f-7d7a-497d-91e6-617da3cf2fe6 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:35.434954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215945df-ecbd-4444-a60d-a8498b5968dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:35.434954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215945df-ecbd-4444-a60d-a8498b5968dc None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:35.435246 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215945df-ecbd-4444-a60d-a8498b5968dc None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:35.435499 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215945df-ecbd-4444-a60d-a8498b5968dc None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:35.436289 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215945df-ecbd-4444-a60d-a8498b5968dc None admin] RBAC: Adding query filter params (name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:35.436663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215945df-ecbd-4444-a60d-a8498b5968dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:35.438151 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215945df-ecbd-4444-a60d-a8498b5968dc None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:35.448489 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:35.449703 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 275/550] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Aug 6 20:36:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:35.450654 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215945df-ecbd-4444-a60d-a8498b5968dc None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:35.472106 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6be26-e3a4-40f0-a042-e840b5a2b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:35.472814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6be26-e3a4-40f0-a042-e840b5a2b154 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:35.473091 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6be26-e3a4-40f0-a042-e840b5a2b154 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:35.473360 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6be26-e3a4-40f0-a042-e840b5a2b154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:35.484992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6be26-e3a4-40f0-a042-e840b5a2b154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:35.486441 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6be26-e3a4-40f0-a042-e840b5a2b154 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-9fc6be26-e3a4-40f0-a042-e840b5a2b154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:35.500179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:35.501170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:35.502007 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:35.502007 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:35.502007 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:35.502007 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 276/551] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:35.502007 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6be26-e3a4-40f0-a042-e840b5a2b154 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:35.564634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215945df-ecbd-4444-a60d-a8498b5968dc None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:35.597523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627ac43-fd9f-473a-b5e0-539ba7475c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:35.598158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627ac43-fd9f-473a-b5e0-539ba7475c86 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:35.598434 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627ac43-fd9f-473a-b5e0-539ba7475c86 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:35.598739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627ac43-fd9f-473a-b5e0-539ba7475c86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:35.600987 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6be26-e3a4-40f0-a042-e840b5a2b154 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:35.608906 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627ac43-fd9f-473a-b5e0-539ba7475c86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-a627ac43-fd9f-473a-b5e0-539ba7475c86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:35.614183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:35.615350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:35.616133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:35.616133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:35.616133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:35.616133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:35.616133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:35.616133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:35.616133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:35.616133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:35.616133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:35.616133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:35.616133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:35.616133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:35.616133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 276/552] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:36:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:35.616133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627ac43-fd9f-473a-b5e0-539ba7475c86 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:35.640357 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8081b-ea23-4ecb-8e4c-75f64538161f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:35.641112 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8081b-ea23-4ecb-8e4c-75f64538161f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:35.641396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8081b-ea23-4ecb-8e4c-75f64538161f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:35.641663 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8081b-ea23-4ecb-8e4c-75f64538161f None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:35.642299 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8081b-ea23-4ecb-8e4c-75f64538161f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:35.642684 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8081b-ea23-4ecb-8e4c-75f64538161f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:35.644062 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8081b-ea23-4ecb-8e4c-75f64538161f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:35.646203 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:35.655402 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 277/553] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:35.656409 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8081b-ea23-4ecb-8e4c-75f64538161f None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:35.680057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:35.718770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627ac43-fd9f-473a-b5e0-539ba7475c86 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:35.753084 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8081b-ea23-4ecb-8e4c-75f64538161f None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:35.753523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b68f2-ef93-4280-8de0-9f0f5749b6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:35.754155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b68f2-ef93-4280-8de0-9f0f5749b6bd None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:35.754454 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b68f2-ef93-4280-8de0-9f0f5749b6bd None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:35.754773 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b68f2-ef93-4280-8de0-9f0f5749b6bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:35.764948 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b68f2-ef93-4280-8de0-9f0f5749b6bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:35.766411 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b68f2-ef93-4280-8de0-9f0f5749b6bd None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-657b68f2-ef93-4280-8de0-9f0f5749b6bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:35.783219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:35.784297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:35.785114 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:35.785114 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:35.785114 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:35.785114 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 277/554] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:35.785334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b68f2-ef93-4280-8de0-9f0f5749b6bd None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:35.790745 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b876c-ab9d-4851-8471-2d95fa58ee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:35.791358 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b876c-ab9d-4851-8471-2d95fa58ee26 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:35.791626 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b876c-ab9d-4851-8471-2d95fa58ee26 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:35.791887 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b876c-ab9d-4851-8471-2d95fa58ee26 None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:35.792517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b876c-ab9d-4851-8471-2d95fa58ee26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:35.792812 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b876c-ab9d-4851-8471-2d95fa58ee26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:35.794179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b876c-ab9d-4851-8471-2d95fa58ee26 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:35.806304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 278/555] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:35.806984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b876c-ab9d-4851-8471-2d95fa58ee26 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:35.866111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:35.885407 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b68f2-ef93-4280-8de0-9f0f5749b6bd None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:35.892754 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:35.909406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b876c-ab9d-4851-8471-2d95fa58ee26 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:35.917809 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb565a9d-da9b-4b7a-bbdc-f09360d94cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:35.918429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb565a9d-da9b-4b7a-bbdc-f09360d94cbf None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:35.918734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb565a9d-da9b-4b7a-bbdc-f09360d94cbf None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:35.918990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb565a9d-da9b-4b7a-bbdc-f09360d94cbf None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:35.919632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb565a9d-da9b-4b7a-bbdc-f09360d94cbf None admin] RBAC: Adding query filter params (name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:35.919930 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb565a9d-da9b-4b7a-bbdc-f09360d94cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:35.921295 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb565a9d-da9b-4b7a-bbdc-f09360d94cbf None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:35.929074 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 278/556] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Aug 6 20:36:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:35.929775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb565a9d-da9b-4b7a-bbdc-f09360d94cbf None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:35.953287 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb12162-5c80-431a-afaf-789ad6bda921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:35.953911 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb12162-5c80-431a-afaf-789ad6bda921 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:35.954180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb12162-5c80-431a-afaf-789ad6bda921 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:35.954442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb12162-5c80-431a-afaf-789ad6bda921 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:35.962225 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb12162-5c80-431a-afaf-789ad6bda921 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:35.963783 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb12162-5c80-431a-afaf-789ad6bda921 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-adb12162-5c80-431a-afaf-789ad6bda921 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:36:35.974813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:35.975782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:35.977097 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:35.977097 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:35.977097 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:36:35.977097 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:36:35.977097 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:36:35.977097 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:36:35.977097 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:36:35.977097 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:36:35.977097 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:36:35.977097 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:35.977097 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 279/557] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:35.977097 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb12162-5c80-431a-afaf-789ad6bda921 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:36.032210 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb565a9d-da9b-4b7a-bbdc-f09360d94cbf None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:36.065812 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e95113-6f8f-4b07-b1ae-661c8580bc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:36.066415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e95113-6f8f-4b07-b1ae-661c8580bc16 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:36.066725 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e95113-6f8f-4b07-b1ae-661c8580bc16 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:36.067001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e95113-6f8f-4b07-b1ae-661c8580bc16 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:36.067624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e95113-6f8f-4b07-b1ae-661c8580bc16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:36.067958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e95113-6f8f-4b07-b1ae-661c8580bc16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:36.069352 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e95113-6f8f-4b07-b1ae-661c8580bc16 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:36.074922 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb12162-5c80-431a-afaf-789ad6bda921 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:36.080873 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 279/558] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:36.081915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e95113-6f8f-4b07-b1ae-661c8580bc16 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:36.086677 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:36.109827 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a1b4f-6036-4317-a3cb-6c6332e24b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:36.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a1b4f-6036-4317-a3cb-6c6332e24b9a None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:36.110766 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a1b4f-6036-4317-a3cb-6c6332e24b9a None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:36.111034 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a1b4f-6036-4317-a3cb-6c6332e24b9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:36.117767 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a1b4f-6036-4317-a3cb-6c6332e24b9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:36.119293 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a1b4f-6036-4317-a3cb-6c6332e24b9a None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:36.130404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-a75a1b4f-6036-4317-a3cb-6c6332e24b9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:36.130404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:36.130404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:36.130404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:36.130404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:36.130404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:36.130404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:36.130404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:36.130404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:36.130404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:36.130404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:36.130404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:36.130404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:36:36.130404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:36:36.130404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:36.131818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:36.133077 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:36:36.133077 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:36:36.133077 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:36:36.133077 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:36:36.133077 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:36:36.133077 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:36:36.133077 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:36.133077 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:36.133077 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 280/559] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:36.133077 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a1b4f-6036-4317-a3cb-6c6332e24b9a None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:36.136676 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:36.185537 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e95113-6f8f-4b07-b1ae-661c8580bc16 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:36.219417 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7540e8-dadc-464f-940d-08576dd82ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:36.220123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7540e8-dadc-464f-940d-08576dd82ace None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:36.220456 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7540e8-dadc-464f-940d-08576dd82ace None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:36.220784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7540e8-dadc-464f-940d-08576dd82ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:36.230936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7540e8-dadc-464f-940d-08576dd82ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:36.232449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a1b4f-6036-4317-a3cb-6c6332e24b9a None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:36.232550 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7540e8-dadc-464f-940d-08576dd82ace None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-5d7540e8-dadc-464f-940d-08576dd82ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:36.247041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:36.248123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:36.253954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:36.253954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:36.253954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:36.253954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 280/560] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:36.253954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7540e8-dadc-464f-940d-08576dd82ace None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:36.266721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c2e8a-b973-4640-ae07-122e8eaee847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:36.267401 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c2e8a-b973-4640-ae07-122e8eaee847 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:36.267735 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c2e8a-b973-4640-ae07-122e8eaee847 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:36.268052 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c2e8a-b973-4640-ae07-122e8eaee847 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:36.268783 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c2e8a-b973-4640-ae07-122e8eaee847 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:36.269077 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c2e8a-b973-4640-ae07-122e8eaee847 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:36.270491 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c2e8a-b973-4640-ae07-122e8eaee847 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:36.287475 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 281/561] 10.222.0.36 () {56 vars in 1137 bytes} [Sat Aug 6 20:36:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:36.288287 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c2e8a-b973-4640-ae07-122e8eaee847 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:36.308956 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:36.348212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:36.353206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7540e8-dadc-464f-940d-08576dd82ace None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:36.386547 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c2e8a-b973-4640-ae07-122e8eaee847 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:36.387937 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b4b5d-1707-4eb7-834b-86051271e906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:36.388547 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b4b5d-1707-4eb7-834b-86051271e906 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:36.388816 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b4b5d-1707-4eb7-834b-86051271e906 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:36.389083 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b4b5d-1707-4eb7-834b-86051271e906 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:36.396387 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b4b5d-1707-4eb7-834b-86051271e906 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:36.397920 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b4b5d-1707-4eb7-834b-86051271e906 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-b00b4b5d-1707-4eb7-834b-86051271e906 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:36:36.409132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:36.410161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:36.411427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:36.411427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:36.411427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:36:36.411427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:36:36.411427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:36:36.411427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:36:36.411427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:36:36.411427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:36:36.411427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:36:36.411427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:36.411427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 281/562] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:36.411427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b4b5d-1707-4eb7-834b-86051271e906 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:36.430945 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90926765-0f47-483d-9b71-8d0685b271b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:36.431560 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90926765-0f47-483d-9b71-8d0685b271b5 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:36.431836 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90926765-0f47-483d-9b71-8d0685b271b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:36.432106 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90926765-0f47-483d-9b71-8d0685b271b5 None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:36.432795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90926765-0f47-483d-9b71-8d0685b271b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:36.433095 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90926765-0f47-483d-9b71-8d0685b271b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:36.434537 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90926765-0f47-483d-9b71-8d0685b271b5 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:36.446099 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 282/563] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:36:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:36.446982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90926765-0f47-483d-9b71-8d0685b271b5 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:36.519734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b4b5d-1707-4eb7-834b-86051271e906 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:36.535886 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:36.551700 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90926765-0f47-483d-9b71-8d0685b271b5 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:36.553405 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8c420-0d57-433a-8520-341b2801ceeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:36.554186 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8c420-0d57-433a-8520-341b2801ceeb None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:36.554540 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8c420-0d57-433a-8520-341b2801ceeb None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:36.554830 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8c420-0d57-433a-8520-341b2801ceeb None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:36.555470 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8c420-0d57-433a-8520-341b2801ceeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:36.555771 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8c420-0d57-433a-8520-341b2801ceeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:36.557145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8c420-0d57-433a-8520-341b2801ceeb None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:36.569353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 282/564] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:36.570162 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8c420-0d57-433a-8520-341b2801ceeb None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:36.573857 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:36.585983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024aaf8f-d63a-40d7-91b9-1296183c1b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:36.586708 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024aaf8f-d63a-40d7-91b9-1296183c1b12 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:36.586984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024aaf8f-d63a-40d7-91b9-1296183c1b12 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:36.587252 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024aaf8f-d63a-40d7-91b9-1296183c1b12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:36.597800 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024aaf8f-d63a-40d7-91b9-1296183c1b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:36.599295 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024aaf8f-d63a-40d7-91b9-1296183c1b12 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-024aaf8f-d63a-40d7-91b9-1296183c1b12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:36.613784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:36.614910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:36.615813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:36.615813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:36.615813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:36.615813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 283/565] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:36.616030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024aaf8f-d63a-40d7-91b9-1296183c1b12 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:36.674523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8c420-0d57-433a-8520-341b2801ceeb None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:36.708066 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe908cf-578d-42de-836a-c25790222fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:36.708672 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe908cf-578d-42de-836a-c25790222fbb None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:36.708961 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe908cf-578d-42de-836a-c25790222fbb None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:36.709210 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe908cf-578d-42de-836a-c25790222fbb None admin] PATH_INFO: `/v3/users` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:36.709929 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe908cf-578d-42de-836a-c25790222fbb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:36.710226 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe908cf-578d-42de-836a-c25790222fbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:36.711927 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe908cf-578d-42de-836a-c25790222fbb None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:36.716998 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024aaf8f-d63a-40d7-91b9-1296183c1b12 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:36.730200 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 283/566] 10.222.0.36 () {56 vars in 1137 bytes} [Sat Aug 6 20:36:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:36.731028 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe908cf-578d-42de-836a-c25790222fbb None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:36.757229 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e7d56-0f4a-4a2e-bff9-78b89a220f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:36.758477 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e7d56-0f4a-4a2e-bff9-78b89a220f6f None admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:36.758785 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e7d56-0f4a-4a2e-bff9-78b89a220f6f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:36.759058 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e7d56-0f4a-4a2e-bff9-78b89a220f6f None admin] PATH_INFO: `/v3/projects/ce157732829848e59f95d0cd15a897eb/users/9f24d354e53845b2a847fdd12077fe61/roles/71540591f26d431ba1b1ccb3615c72ea` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:36.776374 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e7d56-0f4a-4a2e-bff9-78b89a220f6f None admin] RBAC: Authorizing `identity:create_grant(project_id=ce157732829848e59f95d0cd15a897eb, user_id=9f24d354e53845b2a847fdd12077fe61, role_id=71540591f26d431ba1b1ccb3615c72ea)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:36.778611 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e7d56-0f4a-4a2e-bff9-78b89a220f6f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:36.779030 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:36.794307 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 284/567] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:36:36 2022] PUT /identity/v3/projects/ce157732829848e59f95d0cd15a897eb/users/9f24d354e53845b2a847fdd12077fe61/roles/71540591f26d431ba1b1ccb3615c72ea => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:36:36.795157 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e7d56-0f4a-4a2e-bff9-78b89a220f6f None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:36.824755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:36.874226 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe908cf-578d-42de-836a-c25790222fbb None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:36.913033 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bb3b4-3ee9-42cf-a3c2-9971a81409e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:36.914073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bb3b4-3ee9-42cf-a3c2-9971a81409e9 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:36.914352 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bb3b4-3ee9-42cf-a3c2-9971a81409e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:36.914658 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bb3b4-3ee9-42cf-a3c2-9971a81409e9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:36.918081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e7d56-0f4a-4a2e-bff9-78b89a220f6f None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:36.922371 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bb3b4-3ee9-42cf-a3c2-9971a81409e9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:36.923927 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bb3b4-3ee9-42cf-a3c2-9971a81409e9 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-c35bb3b4-3ee9-42cf-a3c2-9971a81409e9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:36:36.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:36.938370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:36.939532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:36.939532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:36.939532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:36:36.939532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:36:36.939532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:36:36.939532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:36:36.939532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:36:36.939532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:36:36.939532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:36:36.939532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:36.939532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 284/568] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:36:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:36.940204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bb3b4-3ee9-42cf-a3c2-9971a81409e9 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:36.966691 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb496f-5d91-4a7e-ae7b-354d8150aee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:36.967635 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb496f-5d91-4a7e-ae7b-354d8150aee0 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:36.968071 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb496f-5d91-4a7e-ae7b-354d8150aee0 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:36.968536 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb496f-5d91-4a7e-ae7b-354d8150aee0 None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:36.969871 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb496f-5d91-4a7e-ae7b-354d8150aee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:36.970191 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb496f-5d91-4a7e-ae7b-354d8150aee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:36.971596 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb496f-5d91-4a7e-ae7b-354d8150aee0 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:36.987009 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 285/569] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:36.987870 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb496f-5d91-4a7e-ae7b-354d8150aee0 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:37.056838 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:37.066428 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bb3b4-3ee9-42cf-a3c2-9971a81409e9 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:37.078482 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:37.097249 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb496f-5d91-4a7e-ae7b-354d8150aee0 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:37.104856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd526f4-2034-43d7-bfee-487afbf81529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:37.105485 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd526f4-2034-43d7-bfee-487afbf81529 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:37.105754 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd526f4-2034-43d7-bfee-487afbf81529 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:37.106016 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd526f4-2034-43d7-bfee-487afbf81529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:37.117660 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd526f4-2034-43d7-bfee-487afbf81529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:37.119161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd526f4-2034-43d7-bfee-487afbf81529 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:37.132458 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de80f0c-7946-4db6-a015-9cf68b34e03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:37.133161 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de80f0c-7946-4db6-a015-9cf68b34e03d None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:37.133443 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de80f0c-7946-4db6-a015-9cf68b34e03d None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:37.133711 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de80f0c-7946-4db6-a015-9cf68b34e03d None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-7dd526f4-2034-43d7-bfee-487afbf81529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:37.133879 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:37.134983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:37.135868 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:37.135868 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:37.135868 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:37.136031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de80f0c-7946-4db6-a015-9cf68b34e03d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:37.136031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de80f0c-7946-4db6-a015-9cf68b34e03d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:37.136162 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 285/570] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:37.136162 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd526f4-2034-43d7-bfee-487afbf81529 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:37.140718 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de80f0c-7946-4db6-a015-9cf68b34e03d None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:37.163217 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 286/571] 10.222.0.36 () {56 vars in 1139 bytes} [Sat Aug 6 20:36:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:37.164210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de80f0c-7946-4db6-a015-9cf68b34e03d None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:37.239438 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd526f4-2034-43d7-bfee-487afbf81529 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:37.267737 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de80f0c-7946-4db6-a015-9cf68b34e03d None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:37.275653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea94233-b738-4d85-a47f-ec6cb8e7cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:37.276278 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea94233-b738-4d85-a47f-ec6cb8e7cd8c None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:37.276557 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea94233-b738-4d85-a47f-ec6cb8e7cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:37.276833 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea94233-b738-4d85-a47f-ec6cb8e7cd8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:37.283671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea94233-b738-4d85-a47f-ec6cb8e7cd8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:37.285129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea94233-b738-4d85-a47f-ec6cb8e7cd8c None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:37.296101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-5ea94233-b738-4d85-a47f-ec6cb8e7cd8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:37.296101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:37.296101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:37.296101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:37.296101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:37.296101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:37.296101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:37.296101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:37.296101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:37.296101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:37.296101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:37.296101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:37.296101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:36:37.296101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:36:37.296101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:37.299048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:37.299923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:36:37.299923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:36:37.299923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:36:37.299923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:36:37.299923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:36:37.299923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:36:37.299923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:37.299923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:37.299923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 286/572] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:37.299923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea94233-b738-4d85-a47f-ec6cb8e7cd8c None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:37.309534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:37.309703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8b253-3b2e-4dbd-a616-d456a8a0cf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:37.310536 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8b253-3b2e-4dbd-a616-d456a8a0cf18 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:37.310536 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8b253-3b2e-4dbd-a616-d456a8a0cf18 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:37.310869 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8b253-3b2e-4dbd-a616-d456a8a0cf18 None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:37.311574 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8b253-3b2e-4dbd-a616-d456a8a0cf18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:37.311871 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8b253-3b2e-4dbd-a616-d456a8a0cf18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:37.313216 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8b253-3b2e-4dbd-a616-d456a8a0cf18 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:37.325505 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 287/573] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:37.326138 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8b253-3b2e-4dbd-a616-d456a8a0cf18 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:37.328719 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:37.413413 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea94233-b738-4d85-a47f-ec6cb8e7cd8c None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:37.431501 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8b253-3b2e-4dbd-a616-d456a8a0cf18 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:37.449731 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9cb9d-8891-42f8-8798-bfb9526b094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:37.450439 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9cb9d-8891-42f8-8798-bfb9526b094e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:37.450803 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9cb9d-8891-42f8-8798-bfb9526b094e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:37.451136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9cb9d-8891-42f8-8798-bfb9526b094e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:37.462324 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9cb9d-8891-42f8-8798-bfb9526b094e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:37.463889 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9cb9d-8891-42f8-8798-bfb9526b094e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:37.466724 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65f38-5e52-42d7-b8c5-648d008d45ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:37.467457 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65f38-5e52-42d7-b8c5-648d008d45ce None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:37.467797 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65f38-5e52-42d7-b8c5-648d008d45ce None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:37.468132 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65f38-5e52-42d7-b8c5-648d008d45ce None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:37.468887 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f65f38-5e52-42d7-b8c5-648d008d45ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:37.469601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f65f38-5e52-42d7-b8c5-648d008d45ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:37.472942 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f65f38-5e52-42d7-b8c5-648d008d45ce None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-09c9cb9d-8891-42f8-8798-bfb9526b094e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:37.481762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:37.482933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:37.484012 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:37.484012 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:37.484012 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:37.484886 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 287/574] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:37.489958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9cb9d-8891-42f8-8798-bfb9526b094e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:37.493470 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 288/575] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:37.493872 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65f38-5e52-42d7-b8c5-648d008d45ce None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:37.555266 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:37.558444 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:37.599351 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9cb9d-8891-42f8-8798-bfb9526b094e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:37.605388 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65f38-5e52-42d7-b8c5-648d008d45ce None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:37.633638 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27f0ec-f4eb-4ec8-8944-d8ac376c109f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:37.634268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27f0ec-f4eb-4ec8-8944-d8ac376c109f None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:37.634550 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27f0ec-f4eb-4ec8-8944-d8ac376c109f None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:37.634855 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27f0ec-f4eb-4ec8-8944-d8ac376c109f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:37.639784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd12d3e-f8f2-4117-a7e3-4a93a39aebdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:37.640379 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd12d3e-f8f2-4117-a7e3-4a93a39aebdf None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:37.640726 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd12d3e-f8f2-4117-a7e3-4a93a39aebdf None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:37.640912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd12d3e-f8f2-4117-a7e3-4a93a39aebdf None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:37.641537 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd12d3e-f8f2-4117-a7e3-4a93a39aebdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:37.641761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27f0ec-f4eb-4ec8-8944-d8ac376c109f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:37.641855 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd12d3e-f8f2-4117-a7e3-4a93a39aebdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:37.643188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd12d3e-f8f2-4117-a7e3-4a93a39aebdf None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:37.643283 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27f0ec-f4eb-4ec8-8944-d8ac376c109f None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:37.658893 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 289/576] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:37.659062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-df27f0ec-f4eb-4ec8-8944-d8ac376c109f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:37.659062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:37.659062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:37.659062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:37.659062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:37.659062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:37.659062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:37.659062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:37.659062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:37.659062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:37.659062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:37.659062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:37.659062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:36:37.659062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:36:37.659062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:37.660084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:37.661117 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:36:37.661117 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:36:37.661117 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:36:37.661117 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:36:37.661117 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:36:37.661117 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:36:37.661117 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:37.661117 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:37.661622 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd12d3e-f8f2-4117-a7e3-4a93a39aebdf None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:37.661702 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 288/577] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:37.661702 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27f0ec-f4eb-4ec8-8944-d8ac376c109f None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:37.765211 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd12d3e-f8f2-4117-a7e3-4a93a39aebdf None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:37.765505 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27f0ec-f4eb-4ec8-8944-d8ac376c109f None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:37.784854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:37.789531 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:37.805066 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65d6e3-4e0e-44cd-808d-fa46ec904972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:37.805708 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65d6e3-4e0e-44cd-808d-fa46ec904972 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:37.805987 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65d6e3-4e0e-44cd-808d-fa46ec904972 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:37.806258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65d6e3-4e0e-44cd-808d-fa46ec904972 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:37.806883 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66897666-266c-4f80-bea6-0a6ca31eaa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:37.807545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66897666-266c-4f80-bea6-0a6ca31eaa7d None admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:37.807822 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66897666-266c-4f80-bea6-0a6ca31eaa7d None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:37.808098 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66897666-266c-4f80-bea6-0a6ca31eaa7d None admin] PATH_INFO: `/v3/projects/ce157732829848e59f95d0cd15a897eb/users/b5c55b636efe4fe483c4905af6ca5115/roles/71540591f26d431ba1b1ccb3615c72ea` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:37.814291 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65d6e3-4e0e-44cd-808d-fa46ec904972 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:37.815852 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65d6e3-4e0e-44cd-808d-fa46ec904972 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:37.823876 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66897666-266c-4f80-bea6-0a6ca31eaa7d None admin] RBAC: Authorizing `identity:create_grant(project_id=ce157732829848e59f95d0cd15a897eb, user_id=b5c55b636efe4fe483c4905af6ca5115, role_id=71540591f26d431ba1b1ccb3615c72ea)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:37.825337 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66897666-266c-4f80-bea6-0a6ca31eaa7d None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:37.828492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-6c65d6e3-4e0e-44cd-808d-fa46ec904972 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:37.828492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:37.828492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:37.828492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:37.828492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:37.828492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:37.828492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:37.828492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:37.828492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:37.828492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:37.828492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:37.828492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:37.828492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:36:37.828492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:36:37.828492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:37.829483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:37.830553 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:36:37.830553 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:36:37.830553 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:36:37.830553 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:36:37.830553 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:36:37.830553 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:36:37.830553 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:37.830553 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:37.830553 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 289/578] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:37.830553 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65d6e3-4e0e-44cd-808d-fa46ec904972 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:37.850178 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 290/579] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:36:37 2022] PUT /identity/v3/projects/ce157732829848e59f95d0cd15a897eb/users/b5c55b636efe4fe483c4905af6ca5115/roles/71540591f26d431ba1b1ccb3615c72ea => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:36:37.851261 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66897666-266c-4f80-bea6-0a6ca31eaa7d None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:37.967927 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66897666-266c-4f80-bea6-0a6ca31eaa7d None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:37.980981 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65d6e3-4e0e-44cd-808d-fa46ec904972 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:38.013605 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d8cf3-6d67-4c60-afcd-e9eb51584575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:38.014227 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d8cf3-6d67-4c60-afcd-e9eb51584575 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:38.014543 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d8cf3-6d67-4c60-afcd-e9eb51584575 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:38.014856 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d8cf3-6d67-4c60-afcd-e9eb51584575 None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:38.015610 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d8cf3-6d67-4c60-afcd-e9eb51584575 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:38.015871 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d8cf3-6d67-4c60-afcd-e9eb51584575 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:38.017405 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d8cf3-6d67-4c60-afcd-e9eb51584575 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:38.031012 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 291/580] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:38.031460 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b4447-dbcb-4ad8-8762-d85ff714a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:38.032155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b4447-dbcb-4ad8-8762-d85ff714a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:38.032454 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b4447-dbcb-4ad8-8762-d85ff714a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:38.032694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b4447-dbcb-4ad8-8762-d85ff714a6e8 None admin] PATH_INFO: `/v3/projects` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:38.033400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b4447-dbcb-4ad8-8762-d85ff714a6e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:38.033702 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b4447-dbcb-4ad8-8762-d85ff714a6e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:38.038686 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b4447-dbcb-4ad8-8762-d85ff714a6e8 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:38.040047 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d8cf3-6d67-4c60-afcd-e9eb51584575 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:38.051847 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 290/581] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:38.060123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b4447-dbcb-4ad8-8762-d85ff714a6e8 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:38.088025 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:38.108082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:38.172877 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d8cf3-6d67-4c60-afcd-e9eb51584575 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:38.192039 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b4447-dbcb-4ad8-8762-d85ff714a6e8 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:38.208671 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de0390-31f0-4ec4-91fe-f875a6b50617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:38.209532 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0390-31f0-4ec4-91fe-f875a6b50617 None admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:38.209905 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0390-31f0-4ec4-91fe-f875a6b50617 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:38.210546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0390-31f0-4ec4-91fe-f875a6b50617 None admin] PATH_INFO: `/v3/projects/ce157732829848e59f95d0cd15a897eb/users/471f571c16f9434e924b3a4589340db4/roles/71540591f26d431ba1b1ccb3615c72ea` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:38.227645 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de0390-31f0-4ec4-91fe-f875a6b50617 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce157732829848e59f95d0cd15a897eb, user_id=471f571c16f9434e924b3a4589340db4, role_id=71540591f26d431ba1b1ccb3615c72ea)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:38.229304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de0390-31f0-4ec4-91fe-f875a6b50617 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:38.234806 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c382ae-7742-407b-9c3b-f34ee7f81369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:38.236735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c382ae-7742-407b-9c3b-f34ee7f81369 None admin] REQUEST_METHOD: `PUT` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:38.236735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c382ae-7742-407b-9c3b-f34ee7f81369 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:38.236735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c382ae-7742-407b-9c3b-f34ee7f81369 None admin] PATH_INFO: `/v3/projects/ce157732829848e59f95d0cd15a897eb/users/df2a0a27fb2b48d0b5210f0263639e47/roles/71540591f26d431ba1b1ccb3615c72ea` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:38.250361 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 292/582] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:36:38 2022] PUT /identity/v3/projects/ce157732829848e59f95d0cd15a897eb/users/471f571c16f9434e924b3a4589340db4/roles/71540591f26d431ba1b1ccb3615c72ea => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:36:38.260958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c382ae-7742-407b-9c3b-f34ee7f81369 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce157732829848e59f95d0cd15a897eb, user_id=df2a0a27fb2b48d0b5210f0263639e47, role_id=71540591f26d431ba1b1ccb3615c72ea)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:38.263032 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c382ae-7742-407b-9c3b-f34ee7f81369 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:38.282298 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 291/583] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:36:38 2022] PUT /identity/v3/projects/ce157732829848e59f95d0cd15a897eb/users/df2a0a27fb2b48d0b5210f0263639e47/roles/71540591f26d431ba1b1ccb3615c72ea => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:36:39.089670 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed51cb-f41e-4c65-a3b6-f2ea7f175a46 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:39.090218 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed51cb-f41e-4c65-a3b6-f2ea7f175a46 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:39.090218 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed51cb-f41e-4c65-a3b6-f2ea7f175a46 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:39.091843 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 293/584] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:39.097982 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74145e-9672-4fa2-b120-cd52b25b14b2 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:39.098443 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74145e-9672-4fa2-b120-cd52b25b14b2 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:39.098520 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74145e-9672-4fa2-b120-cd52b25b14b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:39.117691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-1e74145e-9672-4fa2-b120-cd52b25b14b2 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:39.118902 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-1e74145e-9672-4fa2-b120-cd52b25b14b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:39.185200 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 292/585] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:39.209177 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed51cb-f41e-4c65-a3b6-f2ea7f175a46 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:39.294454 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:39.313955 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed51cb-f41e-4c65-a3b6-f2ea7f175a46 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:39.349299 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b2bbe-f973-4df3-bbe8-66e047f204ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:39.349915 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b2bbe-f973-4df3-bbe8-66e047f204ed None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:39.350198 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b2bbe-f973-4df3-bbe8-66e047f204ed None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:39.350464 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b2bbe-f973-4df3-bbe8-66e047f204ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:39.360717 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b2bbe-f973-4df3-bbe8-66e047f204ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-861b2bbe-f973-4df3-bbe8-66e047f204ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:39.365415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:39.366325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:39.367315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:39.367315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:39.367315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:39.367315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:39.367315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:39.367315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:39.367315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:39.367315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:39.367315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:39.367315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:39.367315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:39.367315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:39.367315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 294/586] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:36:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:39.372524 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74145e-9672-4fa2-b120-cd52b25b14b2 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:39.391104 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:39.491506 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74145e-9672-4fa2-b120-cd52b25b14b2 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:39.532787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d38ba2-a021-4c89-9396-81c13a72b2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:39.533398 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d38ba2-a021-4c89-9396-81c13a72b2f3 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:39.533678 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d38ba2-a021-4c89-9396-81c13a72b2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:39.533944 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d38ba2-a021-4c89-9396-81c13a72b2f3 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:39.534636 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d38ba2-a021-4c89-9396-81c13a72b2f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:39.534938 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d38ba2-a021-4c89-9396-81c13a72b2f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:39.536339 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d38ba2-a021-4c89-9396-81c13a72b2f3 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:39.546193 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 293/587] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Aug 6 20:36:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:39.551534 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b2bbe-f973-4df3-bbe8-66e047f204ed None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:39.651376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b2bbe-f973-4df3-bbe8-66e047f204ed None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:39.684120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b5347-5824-4b20-ae0f-ee1ae647c14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:39.684748 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b5347-5824-4b20-ae0f-ee1ae647c14d None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:39.685018 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b5347-5824-4b20-ae0f-ee1ae647c14d None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:39.685284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b5347-5824-4b20-ae0f-ee1ae647c14d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:39.695989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b5347-5824-4b20-ae0f-ee1ae647c14d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:39.697481 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b5347-5824-4b20-ae0f-ee1ae647c14d None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:39.699222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-ba1b5347-5824-4b20-ae0f-ee1ae647c14d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:39.715814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:39.716820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:39.718373 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:39.718373 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:39.718373 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:39.718373 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 295/588] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:39.723101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d38ba2-a021-4c89-9396-81c13a72b2f3 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:39.812966 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:39.832986 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d38ba2-a021-4c89-9396-81c13a72b2f3 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:39.869646 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523f06-0f11-4071-bbe9-ce65168792d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:39.870308 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523f06-0f11-4071-bbe9-ce65168792d2 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:39.870595 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523f06-0f11-4071-bbe9-ce65168792d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:39.870883 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523f06-0f11-4071-bbe9-ce65168792d2 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:39.871566 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9523f06-0f11-4071-bbe9-ce65168792d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:39.871861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9523f06-0f11-4071-bbe9-ce65168792d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:39.873220 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9523f06-0f11-4071-bbe9-ce65168792d2 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:39.885844 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 294/589] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:39.891387 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b5347-5824-4b20-ae0f-ee1ae647c14d None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:39.995295 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b5347-5824-4b20-ae0f-ee1ae647c14d None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:40.035026 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0f0cf-42c8-48a9-b168-bd7bfd9dff60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:40.035722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0f0cf-42c8-48a9-b168-bd7bfd9dff60 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:40.036010 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0f0cf-42c8-48a9-b168-bd7bfd9dff60 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:40.036284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0f0cf-42c8-48a9-b168-bd7bfd9dff60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:40.044612 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0f0cf-42c8-48a9-b168-bd7bfd9dff60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:40.046067 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0f0cf-42c8-48a9-b168-bd7bfd9dff60 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-96a0f0cf-42c8-48a9-b168-bd7bfd9dff60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:36:40.058180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:40.059200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:40.060157 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:40.060157 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:40.060157 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:36:40.060157 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:36:40.060157 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:36:40.060157 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:36:40.060157 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:36:40.060157 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:36:40.060157 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:36:40.060157 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:40.060157 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 296/590] 10.222.0.36 () {56 vars in 1093 bytes} [Sat Aug 6 20:36:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:40.066433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523f06-0f11-4071-bbe9-ce65168792d2 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:40.172120 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523f06-0f11-4071-bbe9-ce65168792d2 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:40.206329 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852f941-669a-451f-853e-063e78ae0b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:40.206964 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852f941-669a-451f-853e-063e78ae0b9f None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:40.207232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852f941-669a-451f-853e-063e78ae0b9f None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:40.207496 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852f941-669a-451f-853e-063e78ae0b9f None admin] PATH_INFO: `/v3/users` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:40.208215 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852f941-669a-451f-853e-063e78ae0b9f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:40.208515 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852f941-669a-451f-853e-063e78ae0b9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:40.209941 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852f941-669a-451f-853e-063e78ae0b9f None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:40.219878 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:40.229428 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 295/591] 10.222.0.36 () {56 vars in 1133 bytes} [Sat Aug 6 20:36:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:40.235051 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0f0cf-42c8-48a9-b168-bd7bfd9dff60 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:40.247233 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac97a19-d8ab-4957-a491-4386b6725697 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:40.247427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac97a19-d8ab-4957-a491-4386b6725697 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:40.247687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac97a19-d8ab-4957-a491-4386b6725697 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:40.249225 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 296/592] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:36:40.254546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d698730-0ca3-4b6e-a3b8-e03c9af380b5 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:40.254857 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d698730-0ca3-4b6e-a3b8-e03c9af380b5 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:40.255123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d698730-0ca3-4b6e-a3b8-e03c9af380b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:40.274516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-4d698730-0ca3-4b6e-a3b8-e03c9af380b5 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:40.275825 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-4d698730-0ca3-4b6e-a3b8-e03c9af380b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:40.298000 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:40.354867 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 297/593] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:36:40.357875 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0f0cf-42c8-48a9-b168-bd7bfd9dff60 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:40.375567 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d698730-0ca3-4b6e-a3b8-e03c9af380b5 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:40.399784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5923e-c524-451c-b304-fd33f1945781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:40.400559 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5923e-c524-451c-b304-fd33f1945781 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:40.400948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5923e-c524-451c-b304-fd33f1945781 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:40.401548 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5923e-c524-451c-b304-fd33f1945781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:40.494054 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5923e-c524-451c-b304-fd33f1945781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:40.494723 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d698730-0ca3-4b6e-a3b8-e03c9af380b5 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:40.495748 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5923e-c524-451c-b304-fd33f1945781 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:40.524231 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:40.534675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a4d4c-81e3-460b-abe9-68471c7936f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:40.535633 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a4d4c-81e3-460b-abe9-68471c7936f2 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:40.536144 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a4d4c-81e3-460b-abe9-68471c7936f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:40.536552 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a4d4c-81e3-460b-abe9-68471c7936f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:40.556694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a4d4c-81e3-460b-abe9-68471c7936f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-8f8a4d4c-81e3-460b-abe9-68471c7936f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:40.562238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:40.563303 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:40.564113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:40.564113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:40.564113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:40.564113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:40.564113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:40.564113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:40.564113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:40.564113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:40.564113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:40.564113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:40.564113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:40.564113 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:40.566877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 298/594] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:36:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:40.572754 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a4d4c-81e3-460b-abe9-68471c7936f2 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:40.575532 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:40.634299 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 297/595] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:40.639964 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5923e-c524-451c-b304-fd33f1945781 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:40.686137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a4d4c-81e3-460b-abe9-68471c7936f2 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:40.722791 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500d9f3-45e6-4db0-ab97-5e0193e8119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:40.723400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500d9f3-45e6-4db0-ab97-5e0193e8119d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:40.723674 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500d9f3-45e6-4db0-ab97-5e0193e8119d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:40.723939 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500d9f3-45e6-4db0-ab97-5e0193e8119d None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:40.724604 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500d9f3-45e6-4db0-ab97-5e0193e8119d None admin] RBAC: Adding query filter params (name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:40.724909 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500d9f3-45e6-4db0-ab97-5e0193e8119d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:40.726470 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500d9f3-45e6-4db0-ab97-5e0193e8119d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:40.734323 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 299/596] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Aug 6 20:36:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:40.735509 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c03905-d60d-4c73-98db-115d402edda6 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:40.735789 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c03905-d60d-4c73-98db-115d402edda6 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:40.736059 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c03905-d60d-4c73-98db-115d402edda6 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:40.737222 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 300/597] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:40.738216 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc69b5-b415-47ae-ba64-88f2da2a4504 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:40.738492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc69b5-b415-47ae-ba64-88f2da2a4504 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:40.739000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc69b5-b415-47ae-ba64-88f2da2a4504 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:40.742625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 301/598] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:40.742625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc69b5-b415-47ae-ba64-88f2da2a4504 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:40.749646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5923e-c524-451c-b304-fd33f1945781 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:40.784985 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e1a83-4ff8-459f-bfdd-beb469503988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:40.785540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e1a83-4ff8-459f-bfdd-beb469503988 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:40.785816 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e1a83-4ff8-459f-bfdd-beb469503988 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:40.786082 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e1a83-4ff8-459f-bfdd-beb469503988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:40.791524 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:40.796629 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e1a83-4ff8-459f-bfdd-beb469503988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:40.798098 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e1a83-4ff8-459f-bfdd-beb469503988 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-6f5e1a83-4ff8-459f-bfdd-beb469503988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:40.812798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:40.813957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:40.814893 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:40.814893 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:40.814893 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:40.814893 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 298/599] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:40.815384 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690f592-0b38-4dab-be91-754a9c7ea125 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:40.815655 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690f592-0b38-4dab-be91-754a9c7ea125 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:40.815921 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690f592-0b38-4dab-be91-754a9c7ea125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:40.828363 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:40.834042 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-2690f592-0b38-4dab-be91-754a9c7ea125 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:40.835303 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-2690f592-0b38-4dab-be91-754a9c7ea125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:40.846168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc69b5-b415-47ae-ba64-88f2da2a4504 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:40.883924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c54a09-d9d9-4499-ad1a-046d298619a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:40.884554 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c54a09-d9d9-4499-ad1a-046d298619a9 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:40.884831 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c54a09-d9d9-4499-ad1a-046d298619a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:40.885097 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c54a09-d9d9-4499-ad1a-046d298619a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:40.895418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c54a09-d9d9-4499-ad1a-046d298619a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:40.896886 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c54a09-d9d9-4499-ad1a-046d298619a9 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:40.905017 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 299/600] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:40.916778 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832cf52-6a11-44eb-aed5-82da464311e0 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:40.916778 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832cf52-6a11-44eb-aed5-82da464311e0 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:40.916778 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832cf52-6a11-44eb-aed5-82da464311e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-55c54a09-d9d9-4499-ad1a-046d298619a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:40.917095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:40.918123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:40.923268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:40.923268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:40.923268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:40.923268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 302/601] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:40.923268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c54a09-d9d9-4499-ad1a-046d298619a9 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:40.930255 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-b832cf52-6a11-44eb-aed5-82da464311e0 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:40.931660 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-b832cf52-6a11-44eb-aed5-82da464311e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:40.997652 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 300/602] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:40.998620 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832cf52-6a11-44eb-aed5-82da464311e0 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:41.023286 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c54a09-d9d9-4499-ad1a-046d298619a9 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:41.025149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:41.059085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f5d7f-3834-4db2-b25a-f8f83c95e673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:41.059620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f5d7f-3834-4db2-b25a-f8f83c95e673 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:41.060001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f5d7f-3834-4db2-b25a-f8f83c95e673 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:41.060273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f5d7f-3834-4db2-b25a-f8f83c95e673 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:41.060904 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f5d7f-3834-4db2-b25a-f8f83c95e673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:41.061243 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f5d7f-3834-4db2-b25a-f8f83c95e673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:41.062552 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f5d7f-3834-4db2-b25a-f8f83c95e673 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:41.063544 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:41.074208 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 303/603] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:41.074857 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f5d7f-3834-4db2-b25a-f8f83c95e673 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:41.104438 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832cf52-6a11-44eb-aed5-82da464311e0 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:41.138137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2703af-9cda-48d8-b9d5-8b848825d859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:41.138873 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2703af-9cda-48d8-b9d5-8b848825d859 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:41.139080 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2703af-9cda-48d8-b9d5-8b848825d859 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:41.139348 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2703af-9cda-48d8-b9d5-8b848825d859 None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:41.139969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2703af-9cda-48d8-b9d5-8b848825d859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:41.140269 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2703af-9cda-48d8-b9d5-8b848825d859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:41.141640 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2703af-9cda-48d8-b9d5-8b848825d859 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:41.152914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 301/604] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:41.153704 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2703af-9cda-48d8-b9d5-8b848825d859 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:41.176452 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f5d7f-3834-4db2-b25a-f8f83c95e673 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:41.211365 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efd59d-3757-4fdc-a814-663141ada6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:41.212021 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efd59d-3757-4fdc-a814-663141ada6ca None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:41.212291 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efd59d-3757-4fdc-a814-663141ada6ca None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:41.212551 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efd59d-3757-4fdc-a814-663141ada6ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:41.223020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efd59d-3757-4fdc-a814-663141ada6ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-05efd59d-3757-4fdc-a814-663141ada6ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:41.228560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:41.229508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:41.230307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:41.230307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:41.230307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:41.230307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:41.230307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:41.230307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:41.230307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:41.230307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:41.230307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:41.230307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:41.230307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:41.230307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:41.230307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 304/605] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:36:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:41.231024 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efd59d-3757-4fdc-a814-663141ada6ca None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:41.254374 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:41.257803 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2703af-9cda-48d8-b9d5-8b848825d859 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:41.284034 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:41.293821 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4b2ba-8f74-4a8b-a34f-2695d4af17b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:41.294454 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4b2ba-8f74-4a8b-a34f-2695d4af17b4 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:41.294769 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4b2ba-8f74-4a8b-a34f-2695d4af17b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:41.295043 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4b2ba-8f74-4a8b-a34f-2695d4af17b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:41.304968 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4b2ba-8f74-4a8b-a34f-2695d4af17b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-d6d4b2ba-8f74-4a8b-a34f-2695d4af17b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:41.310108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:41.311115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:41.311966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:41.311966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:41.311966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:41.311966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:41.311966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:41.311966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:41.311966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:41.311966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:41.311966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:41.311966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:41.311966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:36:41.311966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:41.311966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 302/606] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:36:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:41.311966 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4b2ba-8f74-4a8b-a34f-2695d4af17b4 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:41.335339 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efd59d-3757-4fdc-a814-663141ada6ca None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:41.369419 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444688fb-6257-4443-8a83-8f0b7d85bb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:41.370046 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444688fb-6257-4443-8a83-8f0b7d85bb72 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:41.370320 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444688fb-6257-4443-8a83-8f0b7d85bb72 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:41.370620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444688fb-6257-4443-8a83-8f0b7d85bb72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:41.377116 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444688fb-6257-4443-8a83-8f0b7d85bb72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:41.378599 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444688fb-6257-4443-8a83-8f0b7d85bb72 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:41.389521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-444688fb-6257-4443-8a83-8f0b7d85bb72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:41.389521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:41.389521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:41.389521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:41.389521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:41.389521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:41.389521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:41.389521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:41.389521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:41.389521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:41.389521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:41.389521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:41.389521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:36:41.389521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:36:41.389521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:41.390462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:41.391402 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:36:41.391402 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:36:41.391402 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:36:41.391402 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:36:41.391402 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:36:41.391402 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:36:41.391402 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:41.391402 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:41.391402 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 305/607] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:41.391402 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444688fb-6257-4443-8a83-8f0b7d85bb72 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:41.414989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4b2ba-8f74-4a8b-a34f-2695d4af17b4 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:41.447523 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4164ae3-6e75-4be3-956e-6a4407baaaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:41.448147 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4164ae3-6e75-4be3-956e-6a4407baaaad None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:41.448415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4164ae3-6e75-4be3-956e-6a4407baaaad None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:41.448677 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4164ae3-6e75-4be3-956e-6a4407baaaad None admin] PATH_INFO: `/v3/users/glance` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:41.456431 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4164ae3-6e75-4be3-956e-6a4407baaaad None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:41.457997 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4164ae3-6e75-4be3-956e-6a4407baaaad None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-a4164ae3-6e75-4be3-956e-6a4407baaaad None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:36:41.473093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:41.474085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:41.475159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:41.475159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:41.475159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:36:41.475159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:36:41.475159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:36:41.475159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:36:41.475159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:36:41.475159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:36:41.475159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:36:41.475159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:41.475159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 303/608] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:41.475741 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4164ae3-6e75-4be3-956e-6a4407baaaad None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:41.479862 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:41.499630 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444688fb-6257-4443-8a83-8f0b7d85bb72 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:41.525532 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:41.533709 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca3738-1688-4600-865a-7d260c47c887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:41.534302 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca3738-1688-4600-865a-7d260c47c887 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:41.534595 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca3738-1688-4600-865a-7d260c47c887 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:41.534877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca3738-1688-4600-865a-7d260c47c887 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:41.535542 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca3738-1688-4600-865a-7d260c47c887 None admin] RBAC: Adding query filter params (name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:41.535840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca3738-1688-4600-865a-7d260c47c887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:41.537237 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca3738-1688-4600-865a-7d260c47c887 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:41.545873 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 306/609] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Aug 6 20:36:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:41.546702 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca3738-1688-4600-865a-7d260c47c887 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:41.580700 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4164ae3-6e75-4be3-956e-6a4407baaaad None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:41.614518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ab4a8-9786-4e0d-8547-61e8e635f531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:41.615173 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ab4a8-9786-4e0d-8547-61e8e635f531 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:41.615446 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ab4a8-9786-4e0d-8547-61e8e635f531 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:41.615715 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ab4a8-9786-4e0d-8547-61e8e635f531 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:41.616377 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ab4a8-9786-4e0d-8547-61e8e635f531 None admin] RBAC: Adding query filter params (name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:41.616874 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ab4a8-9786-4e0d-8547-61e8e635f531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:41.618303 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ab4a8-9786-4e0d-8547-61e8e635f531 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:41.626440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 304/610] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Aug 6 20:36:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:41.627256 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ab4a8-9786-4e0d-8547-61e8e635f531 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:41.648461 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca3738-1688-4600-865a-7d260c47c887 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:41.681544 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451891f-e300-4ebc-9406-e678a5e4c68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:41.682147 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451891f-e300-4ebc-9406-e678a5e4c68d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:41.682414 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451891f-e300-4ebc-9406-e678a5e4c68d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:41.682716 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451891f-e300-4ebc-9406-e678a5e4c68d None admin] PATH_INFO: `/v3/projects` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:41.683395 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451891f-e300-4ebc-9406-e678a5e4c68d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:41.683690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451891f-e300-4ebc-9406-e678a5e4c68d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:41.685121 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451891f-e300-4ebc-9406-e678a5e4c68d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:41.696794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 307/611] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:36:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:41.697575 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451891f-e300-4ebc-9406-e678a5e4c68d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:41.703175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:41.726107 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ab4a8-9786-4e0d-8547-61e8e635f531 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:41.734686 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:41.759315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a913cd-005b-4d53-ab5e-71a46f0ae043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:41.759924 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a913cd-005b-4d53-ab5e-71a46f0ae043 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:41.760197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a913cd-005b-4d53-ab5e-71a46f0ae043 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:41.760462 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a913cd-005b-4d53-ab5e-71a46f0ae043 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:41.761206 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a913cd-005b-4d53-ab5e-71a46f0ae043 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:41.761508 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a913cd-005b-4d53-ab5e-71a46f0ae043 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:41.762949 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a913cd-005b-4d53-ab5e-71a46f0ae043 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:41.784482 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 305/612] 10.222.0.36 () {56 vars in 1137 bytes} [Sat Aug 6 20:36:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:41.784482 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a913cd-005b-4d53-ab5e-71a46f0ae043 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:41.802731 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451891f-e300-4ebc-9406-e678a5e4c68d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:41.837815 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4713579-799e-41dc-9c96-d8347714d5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:41.838365 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4713579-799e-41dc-9c96-d8347714d5b1 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:41.838669 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4713579-799e-41dc-9c96-d8347714d5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:41.838937 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4713579-799e-41dc-9c96-d8347714d5b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:41.849366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4713579-799e-41dc-9c96-d8347714d5b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:41.850894 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4713579-799e-41dc-9c96-d8347714d5b1 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-e4713579-799e-41dc-9c96-d8347714d5b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:41.865555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:41.866632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:41.867563 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:41.867563 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:41.867563 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:41.867563 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 308/613] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:41.868225 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4713579-799e-41dc-9c96-d8347714d5b1 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:41.880536 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a913cd-005b-4d53-ab5e-71a46f0ae043 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:41.920362 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797334c-3892-4004-90aa-46e01b54ab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:41.920999 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797334c-3892-4004-90aa-46e01b54ab46 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:41.921276 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797334c-3892-4004-90aa-46e01b54ab46 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:41.921542 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797334c-3892-4004-90aa-46e01b54ab46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:41.931337 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:41.932207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797334c-3892-4004-90aa-46e01b54ab46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:41.933660 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797334c-3892-4004-90aa-46e01b54ab46 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-e797334c-3892-4004-90aa-46e01b54ab46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:41.951036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:41.952137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:41.953271 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:41.953271 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:41.953271 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:41.953271 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 306/614] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:41.953271 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797334c-3892-4004-90aa-46e01b54ab46 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:41.975670 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:41.984858 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4713579-799e-41dc-9c96-d8347714d5b1 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:42.019215 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd01e05-ce9f-4c24-851d-cc09e960ad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:42.019823 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd01e05-ce9f-4c24-851d-cc09e960ad78 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:42.020098 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd01e05-ce9f-4c24-851d-cc09e960ad78 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:42.020368 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd01e05-ce9f-4c24-851d-cc09e960ad78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:42.021087 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd01e05-ce9f-4c24-851d-cc09e960ad78 None admin] RBAC: Adding query filter params (role.id=71540591f26d431ba1b1ccb3615c72ea, scope.project.id=ce157732829848e59f95d0cd15a897eb, user.id=9f24d354e53845b2a847fdd12077fe61) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:42.021394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd01e05-ce9f-4c24-851d-cc09e960ad78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:42.023299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd01e05-ce9f-4c24-851d-cc09e960ad78 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:42.028980 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 309/615] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:36:41 2022] GET /identity/v3/role_assignments?user.id=9f24d354e53845b2a847fdd12077fe61&scope.project.id=ce157732829848e59f95d0cd15a897eb&role.id=71540591f26d431ba1b1ccb3615c72ea => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:42.029737 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd01e05-ce9f-4c24-851d-cc09e960ad78 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:42.062438 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797334c-3892-4004-90aa-46e01b54ab46 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:42.101852 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f945b-37b7-4f0c-8988-47d52f6a0f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:42.102384 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f945b-37b7-4f0c-8988-47d52f6a0f64 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:42.102852 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f945b-37b7-4f0c-8988-47d52f6a0f64 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:42.102957 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f945b-37b7-4f0c-8988-47d52f6a0f64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:42.158481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd01e05-ce9f-4c24-851d-cc09e960ad78 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:42.179523 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f945b-37b7-4f0c-8988-47d52f6a0f64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:42.181036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f945b-37b7-4f0c-8988-47d52f6a0f64 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:42.181632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:42.196671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d45c4-474f-4c0a-9b40-783ac937df6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:42.197292 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d45c4-474f-4c0a-9b40-783ac937df6e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:42.197562 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d45c4-474f-4c0a-9b40-783ac937df6e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:42.197839 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d45c4-474f-4c0a-9b40-783ac937df6e None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:42.198466 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d45c4-474f-4c0a-9b40-783ac937df6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:42.198797 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d45c4-474f-4c0a-9b40-783ac937df6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:42.200166 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d45c4-474f-4c0a-9b40-783ac937df6e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:42.203269 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:42.213483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 310/616] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:42.214341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d45c4-474f-4c0a-9b40-783ac937df6e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:42.297139 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 307/617] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:42.298084 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f945b-37b7-4f0c-8988-47d52f6a0f64 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:42.336851 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d45c4-474f-4c0a-9b40-783ac937df6e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:42.375314 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bffe94-b030-40d0-9536-2c1f9f13e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:42.375953 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bffe94-b030-40d0-9536-2c1f9f13e91b None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:42.376290 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bffe94-b030-40d0-9536-2c1f9f13e91b None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:42.376629 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bffe94-b030-40d0-9536-2c1f9f13e91b None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:42.377333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bffe94-b030-40d0-9536-2c1f9f13e91b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:42.377696 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bffe94-b030-40d0-9536-2c1f9f13e91b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:42.379188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bffe94-b030-40d0-9536-2c1f9f13e91b None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:42.391142 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 311/618] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:42.391961 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bffe94-b030-40d0-9536-2c1f9f13e91b None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:42.408184 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f945b-37b7-4f0c-8988-47d52f6a0f64 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:42.426137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:42.438792 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:42.446107 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f17693-a9cd-4ed2-9f72-684b949badb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:42.446785 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f17693-a9cd-4ed2-9f72-684b949badb6 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:42.447065 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f17693-a9cd-4ed2-9f72-684b949badb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:42.447574 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f17693-a9cd-4ed2-9f72-684b949badb6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:42.455246 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f17693-a9cd-4ed2-9f72-684b949badb6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:42.456760 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f17693-a9cd-4ed2-9f72-684b949badb6 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-75f17693-a9cd-4ed2-9f72-684b949badb6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:36:42.468943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:42.470270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:42.471248 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:42.471248 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:42.471248 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:36:42.471248 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:36:42.471248 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:36:42.471248 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:36:42.471248 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:36:42.471248 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:36:42.471248 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:36:42.471248 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:42.471248 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 308/619] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:36:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:42.471855 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f17693-a9cd-4ed2-9f72-684b949badb6 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:42.508700 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bffe94-b030-40d0-9536-2c1f9f13e91b None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:42.544163 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19106a-eb0a-4786-8d0b-f2eb69484272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:42.544802 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19106a-eb0a-4786-8d0b-f2eb69484272 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:42.545077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19106a-eb0a-4786-8d0b-f2eb69484272 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:42.545340 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19106a-eb0a-4786-8d0b-f2eb69484272 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:42.557045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19106a-eb0a-4786-8d0b-f2eb69484272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:42.558679 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19106a-eb0a-4786-8d0b-f2eb69484272 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-de19106a-eb0a-4786-8d0b-f2eb69484272 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:42.572761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:42.573714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:42.574695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:42.574695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:42.574695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:42.574695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 312/620] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:42.574695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19106a-eb0a-4786-8d0b-f2eb69484272 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:42.590839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f17693-a9cd-4ed2-9f72-684b949badb6 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:42.631908 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88cba1-7480-4316-96fc-4ade1b239a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:42.632496 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88cba1-7480-4316-96fc-4ade1b239a0b None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:42.632770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88cba1-7480-4316-96fc-4ade1b239a0b None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:42.633036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88cba1-7480-4316-96fc-4ade1b239a0b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:42.641321 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88cba1-7480-4316-96fc-4ade1b239a0b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:42.642778 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88cba1-7480-4316-96fc-4ade1b239a0b None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-7f88cba1-7480-4316-96fc-4ade1b239a0b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:36:42.654222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:42.655222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:42.656339 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:42.656339 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:42.656339 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:36:42.656339 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:36:42.656339 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:36:42.656339 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:36:42.656339 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:36:42.656339 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:36:42.656339 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:36:42.656339 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:42.658209 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 309/621] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:42.659186 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88cba1-7480-4316-96fc-4ade1b239a0b None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:42.680396 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:42.690028 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19106a-eb0a-4786-8d0b-f2eb69484272 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:42.700791 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:42.727284 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f976600-c9d2-44c8-a133-e473aefbafcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:42.727900 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f976600-c9d2-44c8-a133-e473aefbafcc None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:42.728405 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f976600-c9d2-44c8-a133-e473aefbafcc None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:42.728733 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f976600-c9d2-44c8-a133-e473aefbafcc None admin] PATH_INFO: `/v3/users` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:42.729654 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f976600-c9d2-44c8-a133-e473aefbafcc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:42.729960 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f976600-c9d2-44c8-a133-e473aefbafcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:42.731977 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f976600-c9d2-44c8-a133-e473aefbafcc None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:42.750333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 313/622] 10.222.0.36 () {56 vars in 1139 bytes} [Sat Aug 6 20:36:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:42.751277 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f976600-c9d2-44c8-a133-e473aefbafcc None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:42.781438 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88cba1-7480-4316-96fc-4ade1b239a0b None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:42.817725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de97a6-2093-4f2f-9c85-aa96a08a6f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:42.818755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de97a6-2093-4f2f-9c85-aa96a08a6f1f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:42.819177 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de97a6-2093-4f2f-9c85-aa96a08a6f1f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:42.819640 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de97a6-2093-4f2f-9c85-aa96a08a6f1f None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:42.820359 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de97a6-2093-4f2f-9c85-aa96a08a6f1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:42.820678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de97a6-2093-4f2f-9c85-aa96a08a6f1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:42.822193 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de97a6-2093-4f2f-9c85-aa96a08a6f1f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:42.840106 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 310/623] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:42.840989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de97a6-2093-4f2f-9c85-aa96a08a6f1f None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:42.858912 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f976600-c9d2-44c8-a133-e473aefbafcc None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:42.898541 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e956e6-5d8b-4a6b-a143-a6fc48926b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:42.899102 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e956e6-5d8b-4a6b-a143-a6fc48926b88 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:42.899378 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e956e6-5d8b-4a6b-a143-a6fc48926b88 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:42.899648 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e956e6-5d8b-4a6b-a143-a6fc48926b88 None admin] PATH_INFO: `/v3/users` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:42.900379 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e956e6-5d8b-4a6b-a143-a6fc48926b88 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:42.900691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e956e6-5d8b-4a6b-a143-a6fc48926b88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:42.902139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e956e6-5d8b-4a6b-a143-a6fc48926b88 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:42.920116 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 314/624] 10.222.0.36 () {56 vars in 1137 bytes} [Sat Aug 6 20:36:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:42.920924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e956e6-5d8b-4a6b-a143-a6fc48926b88 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:42.934066 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:42.944985 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:42.949517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de97a6-2093-4f2f-9c85-aa96a08a6f1f None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:42.984985 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8325922-960f-4f9d-b330-46616b2b9606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:42.985599 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8325922-960f-4f9d-b330-46616b2b9606 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:42.985871 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8325922-960f-4f9d-b330-46616b2b9606 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:42.986141 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8325922-960f-4f9d-b330-46616b2b9606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:43.027873 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e956e6-5d8b-4a6b-a143-a6fc48926b88 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:43.058999 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8325922-960f-4f9d-b330-46616b2b9606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:43.060475 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8325922-960f-4f9d-b330-46616b2b9606 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:43.064684 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e76bf-e733-48d1-bec0-b12da14216c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:43.065572 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e76bf-e733-48d1-bec0-b12da14216c5 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:43.066058 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e76bf-e733-48d1-bec0-b12da14216c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:43.066523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e76bf-e733-48d1-bec0-b12da14216c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:43.074011 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e76bf-e733-48d1-bec0-b12da14216c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:43.075992 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e76bf-e733-48d1-bec0-b12da14216c5 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:43.088250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-fb3e76bf-e733-48d1-bec0-b12da14216c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:43.088250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:43.088250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:43.088250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:43.088250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:43.088250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:43.088250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:43.088250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:43.088250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:43.088250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:43.088250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:43.088250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:43.088250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:36:43.088250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:36:43.088250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:43.089123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:43.089981 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:36:43.089981 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:36:43.089981 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:36:43.089981 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:36:43.089981 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:36:43.089981 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:36:43.089981 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:43.089981 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:43.092148 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 315/625] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:43.093111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e76bf-e733-48d1-bec0-b12da14216c5 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:43.160977 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:43.163672 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:43.166986 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 311/626] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:43.167685 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8325922-960f-4f9d-b330-46616b2b9606 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:43.201278 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e76bf-e733-48d1-bec0-b12da14216c5 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:43.238502 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb85295-4057-47bb-97c8-ff741e014868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:43.239225 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb85295-4057-47bb-97c8-ff741e014868 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:43.239499 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb85295-4057-47bb-97c8-ff741e014868 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:43.239770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb85295-4057-47bb-97c8-ff741e014868 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:43.274296 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8325922-960f-4f9d-b330-46616b2b9606 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:43.310870 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f3a84-94e8-4bef-bbe4-204b42768d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:43.311517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f3a84-94e8-4bef-bbe4-204b42768d44 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:43.311746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f3a84-94e8-4bef-bbe4-204b42768d44 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:43.312049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f3a84-94e8-4bef-bbe4-204b42768d44 None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:43.312706 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f3a84-94e8-4bef-bbe4-204b42768d44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:43.313010 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f3a84-94e8-4bef-bbe4-204b42768d44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:43.313624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb85295-4057-47bb-97c8-ff741e014868 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:43.314442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f3a84-94e8-4bef-bbe4-204b42768d44 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:43.315115 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb85295-4057-47bb-97c8-ff741e014868 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:43.326072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 312/627] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:36:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:43.326922 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f3a84-94e8-4bef-bbe4-204b42768d44 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:43.389978 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:43.395671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:43.432915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 316/628] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:43.434467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb85295-4057-47bb-97c8-ff741e014868 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:43.435470 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f3a84-94e8-4bef-bbe4-204b42768d44 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:43.471419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350456b-8bd5-4ddd-b206-be9bfbf2a086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:43.472051 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350456b-8bd5-4ddd-b206-be9bfbf2a086 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:43.472326 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350456b-8bd5-4ddd-b206-be9bfbf2a086 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:43.472593 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350456b-8bd5-4ddd-b206-be9bfbf2a086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:43.485928 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350456b-8bd5-4ddd-b206-be9bfbf2a086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:43.487398 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350456b-8bd5-4ddd-b206-be9bfbf2a086 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-b350456b-8bd5-4ddd-b206-be9bfbf2a086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:43.502449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:43.503549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:43.504439 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:43.504439 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:43.504439 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:43.504439 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 313/629] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:43.504439 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350456b-8bd5-4ddd-b206-be9bfbf2a086 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:43.554270 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb85295-4057-47bb-97c8-ff741e014868 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:43.590041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d354a-5302-4acd-9fff-57677d1dcfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:43.590683 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d354a-5302-4acd-9fff-57677d1dcfd0 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:43.590962 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d354a-5302-4acd-9fff-57677d1dcfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:43.591230 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d354a-5302-4acd-9fff-57677d1dcfd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:43.591949 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d354a-5302-4acd-9fff-57677d1dcfd0 None admin] RBAC: Adding query filter params (role.id=71540591f26d431ba1b1ccb3615c72ea, scope.project.id=ce157732829848e59f95d0cd15a897eb, user.id=b5c55b636efe4fe483c4905af6ca5115) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:43.592254 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d354a-5302-4acd-9fff-57677d1dcfd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:43.593694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d354a-5302-4acd-9fff-57677d1dcfd0 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:43.600197 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 317/630] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:36:43 2022] GET /identity/v3/role_assignments?user.id=b5c55b636efe4fe483c4905af6ca5115&scope.project.id=ce157732829848e59f95d0cd15a897eb&role.id=71540591f26d431ba1b1ccb3615c72ea => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:43.601639 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d354a-5302-4acd-9fff-57677d1dcfd0 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:43.615392 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350456b-8bd5-4ddd-b206-be9bfbf2a086 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:43.629489 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:43.657749 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63502c87-6f99-494d-87db-d981709dbbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:43.658395 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63502c87-6f99-494d-87db-d981709dbbc8 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:43.658723 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63502c87-6f99-494d-87db-d981709dbbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:43.658830 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:43.658994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63502c87-6f99-494d-87db-d981709dbbc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:43.677140 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63502c87-6f99-494d-87db-d981709dbbc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:43.679738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63502c87-6f99-494d-87db-d981709dbbc8 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-63502c87-6f99-494d-87db-d981709dbbc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:43.699577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:43.700563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:43.701442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:43.701442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:43.701442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:43.701442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 314/631] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:43.706405 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63502c87-6f99-494d-87db-d981709dbbc8 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:43.760178 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d354a-5302-4acd-9fff-57677d1dcfd0 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:43.809536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66bdd4-80e3-43a8-8dcc-9e1d2e652d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:43.810252 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66bdd4-80e3-43a8-8dcc-9e1d2e652d30 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:43.811250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66bdd4-80e3-43a8-8dcc-9e1d2e652d30 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:43.811374 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66bdd4-80e3-43a8-8dcc-9e1d2e652d30 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:43.812012 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66bdd4-80e3-43a8-8dcc-9e1d2e652d30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:43.812644 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66bdd4-80e3-43a8-8dcc-9e1d2e652d30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:43.814059 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66bdd4-80e3-43a8-8dcc-9e1d2e652d30 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:43.833633 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 318/632] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:43.839493 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66bdd4-80e3-43a8-8dcc-9e1d2e652d30 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:43.847985 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63502c87-6f99-494d-87db-d981709dbbc8 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:43.890216 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd545-d883-401b-9d41-35538908c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:43.890869 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd545-d883-401b-9d41-35538908c538 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:43.892095 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd545-d883-401b-9d41-35538908c538 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:43.892095 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd545-d883-401b-9d41-35538908c538 None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:43.892095 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedd545-d883-401b-9d41-35538908c538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:43.892398 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedd545-d883-401b-9d41-35538908c538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:43.894215 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedd545-d883-401b-9d41-35538908c538 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:43.909570 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 315/633] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:43.916293 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd545-d883-401b-9d41-35538908c538 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:43.944327 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:43.958291 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:43.973481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66bdd4-80e3-43a8-8dcc-9e1d2e652d30 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:44.010545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae5da4-6568-43c1-bb59-5a6315abbf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:44.011614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae5da4-6568-43c1-bb59-5a6315abbf9c None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:44.012219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae5da4-6568-43c1-bb59-5a6315abbf9c None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:44.012630 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae5da4-6568-43c1-bb59-5a6315abbf9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:44.020147 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae5da4-6568-43c1-bb59-5a6315abbf9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:44.021961 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae5da4-6568-43c1-bb59-5a6315abbf9c None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:44.034877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-c0ae5da4-6568-43c1-bb59-5a6315abbf9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:44.034877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:44.034877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:44.034877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:44.034877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:44.034877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:44.034877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:44.034877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:44.034877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:44.034877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:44.034877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:44.034877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:44.034877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:36:44.034877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:36:44.034877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:44.035994 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:44.037090 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:36:44.037090 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:36:44.037090 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:36:44.037090 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:36:44.037090 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:36:44.037090 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:36:44.037090 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:44.037090 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:44.037923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd545-d883-401b-9d41-35538908c538 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:44.039628 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 319/634] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:44.045749 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae5da4-6568-43c1-bb59-5a6315abbf9c None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:44.087182 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64495384-25e5-4767-b191-45bbdb1609c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:44.087967 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64495384-25e5-4767-b191-45bbdb1609c7 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:44.088336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64495384-25e5-4767-b191-45bbdb1609c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:44.088695 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64495384-25e5-4767-b191-45bbdb1609c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:44.097474 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64495384-25e5-4767-b191-45bbdb1609c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:44.099219 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64495384-25e5-4767-b191-45bbdb1609c7 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:44.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-64495384-25e5-4767-b191-45bbdb1609c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:44.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:44.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:44.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:44.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:44.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:44.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:44.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:44.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:44.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:44.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:44.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:44.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:36:44.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:36:44.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:44.115304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:44.116510 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:36:44.116510 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:36:44.116510 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:36:44.116510 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:36:44.116510 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:36:44.116510 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:36:44.116510 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:44.116510 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:44.118317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 316/635] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:44.127846 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64495384-25e5-4767-b191-45bbdb1609c7 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:44.166134 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae5da4-6568-43c1-bb59-5a6315abbf9c None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:44.210641 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058061e2-838a-497a-a0d7-233579aadc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:44.211464 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058061e2-838a-497a-a0d7-233579aadc8e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:44.219721 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058061e2-838a-497a-a0d7-233579aadc8e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:44.219721 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058061e2-838a-497a-a0d7-233579aadc8e None admin] PATH_INFO: `/v3/projects` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:44.220398 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058061e2-838a-497a-a0d7-233579aadc8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:44.220708 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058061e2-838a-497a-a0d7-233579aadc8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:44.222246 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058061e2-838a-497a-a0d7-233579aadc8e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:44.234297 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:44.239507 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 320/636] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:44.244939 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058061e2-838a-497a-a0d7-233579aadc8e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:44.255452 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64495384-25e5-4767-b191-45bbdb1609c7 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:44.262714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:44.304382 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891dcb-e7be-43dc-9cdc-6833def259ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:44.305654 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891dcb-e7be-43dc-9cdc-6833def259ae None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:44.306458 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891dcb-e7be-43dc-9cdc-6833def259ae None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:44.306949 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891dcb-e7be-43dc-9cdc-6833def259ae None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:44.307791 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb891dcb-e7be-43dc-9cdc-6833def259ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:44.308237 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb891dcb-e7be-43dc-9cdc-6833def259ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:44.310970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb891dcb-e7be-43dc-9cdc-6833def259ae None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:44.329115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 317/637] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:44.337517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891dcb-e7be-43dc-9cdc-6833def259ae None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:44.366969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058061e2-838a-497a-a0d7-233579aadc8e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:44.402712 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866c5e6-7b63-48b5-b784-260f6a7c20cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:44.403388 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c5e6-7b63-48b5-b784-260f6a7c20cf None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:44.403662 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c5e6-7b63-48b5-b784-260f6a7c20cf None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:44.403929 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c5e6-7b63-48b5-b784-260f6a7c20cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:44.404777 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866c5e6-7b63-48b5-b784-260f6a7c20cf None admin] RBAC: Adding query filter params (role.id=71540591f26d431ba1b1ccb3615c72ea, scope.project.id=ce157732829848e59f95d0cd15a897eb, user.id=471f571c16f9434e924b3a4589340db4) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:44.405161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866c5e6-7b63-48b5-b784-260f6a7c20cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:44.406629 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866c5e6-7b63-48b5-b784-260f6a7c20cf None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:44.412914 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 321/638] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:36:44 2022] GET /identity/v3/role_assignments?user.id=471f571c16f9434e924b3a4589340db4&scope.project.id=ce157732829848e59f95d0cd15a897eb&role.id=71540591f26d431ba1b1ccb3615c72ea => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:44.414287 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024bb3b-97c6-475e-8559-5916ad5ec504 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:44.414561 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024bb3b-97c6-475e-8559-5916ad5ec504 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:44.414854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024bb3b-97c6-475e-8559-5916ad5ec504 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:44.418721 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 322/639] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:44.426734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f3155-e991-485e-8587-0929d785152b None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:44.426734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f3155-e991-485e-8587-0929d785152b None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:44.426734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f3155-e991-485e-8587-0929d785152b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:44.442235 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-e75f3155-e991-485e-8587-0929d785152b None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:44.443608 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-e75f3155-e991-485e-8587-0929d785152b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:44.460884 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891dcb-e7be-43dc-9cdc-6833def259ae None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:44.504806 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b5859-0f6e-4028-9118-9d4e1aac3381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:44.505423 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b5859-0f6e-4028-9118-9d4e1aac3381 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:44.505703 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b5859-0f6e-4028-9118-9d4e1aac3381 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:44.506060 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b5859-0f6e-4028-9118-9d4e1aac3381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:44.506921 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b5859-0f6e-4028-9118-9d4e1aac3381 None admin] RBAC: Adding query filter params (role.id=71540591f26d431ba1b1ccb3615c72ea, scope.project.id=ce157732829848e59f95d0cd15a897eb, user.id=df2a0a27fb2b48d0b5210f0263639e47) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:44.507422 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b5859-0f6e-4028-9118-9d4e1aac3381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:44.509353 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b5859-0f6e-4028-9118-9d4e1aac3381 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:44.523168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 318/640] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:36:44 2022] GET /identity/v3/role_assignments?user.id=df2a0a27fb2b48d0b5210f0263639e47&scope.project.id=ce157732829848e59f95d0cd15a897eb&role.id=71540591f26d431ba1b1ccb3615c72ea => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:44.551757 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 323/641] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:44.576954 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b5859-0f6e-4028-9118-9d4e1aac3381 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:44.588612 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:44.699534 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b5859-0f6e-4028-9118-9d4e1aac3381 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:44.738238 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c110fb6-0248-47c6-ac38-442f029a3d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:44.738238 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c110fb6-0248-47c6-ac38-442f029a3d60 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:44.738536 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c110fb6-0248-47c6-ac38-442f029a3d60 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:44.738815 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c110fb6-0248-47c6-ac38-442f029a3d60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:44.752340 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c110fb6-0248-47c6-ac38-442f029a3d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-4c110fb6-0248-47c6-ac38-442f029a3d60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:44.757551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:44.758553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:44.759775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:44.759775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:44.759775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:44.759775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:44.759775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:44.759775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:44.759775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:44.759775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:44.759775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:44.759775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:44.759775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:36:44.759775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:44.759775 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 319/642] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:36:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:44.766607 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f3155-e991-485e-8587-0929d785152b None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:44.775905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:44.885833 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f3155-e991-485e-8587-0929d785152b None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:44.922087 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa8e8f-0da3-4d20-a730-8c8ddb775963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:44.922747 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa8e8f-0da3-4d20-a730-8c8ddb775963 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:44.923304 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa8e8f-0da3-4d20-a730-8c8ddb775963 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:44.923572 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa8e8f-0da3-4d20-a730-8c8ddb775963 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:44.924238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa8e8f-0da3-4d20-a730-8c8ddb775963 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:44.924537 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa8e8f-0da3-4d20-a730-8c8ddb775963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:44.925901 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa8e8f-0da3-4d20-a730-8c8ddb775963 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:44.935518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 324/643] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:44.940798 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c110fb6-0248-47c6-ac38-442f029a3d60 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:45.014028 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:45.052230 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c110fb6-0248-47c6-ac38-442f029a3d60 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:45.087454 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cccf3f-09c6-43e0-8f2d-f87ee5ea6a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:45.088088 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cccf3f-09c6-43e0-8f2d-f87ee5ea6a0a None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:45.088366 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cccf3f-09c6-43e0-8f2d-f87ee5ea6a0a None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:45.088632 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cccf3f-09c6-43e0-8f2d-f87ee5ea6a0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:45.099829 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cccf3f-09c6-43e0-8f2d-f87ee5ea6a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:45.101723 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cccf3f-09c6-43e0-8f2d-f87ee5ea6a0a None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-11cccf3f-09c6-43e0-8f2d-f87ee5ea6a0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:45.116162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:45.117294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:45.118197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:45.118197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:45.118197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:45.118197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 320/644] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:45.123698 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa8e8f-0da3-4d20-a730-8c8ddb775963 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:45.194117 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:45.230350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa8e8f-0da3-4d20-a730-8c8ddb775963 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:45.267582 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a8269-3085-4424-877e-b342f108bfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:45.268208 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8269-3085-4424-877e-b342f108bfb4 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:45.268577 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8269-3085-4424-877e-b342f108bfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:45.268915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8269-3085-4424-877e-b342f108bfb4 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:45.269627 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a8269-3085-4424-877e-b342f108bfb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:45.269995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a8269-3085-4424-877e-b342f108bfb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:45.271473 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a8269-3085-4424-877e-b342f108bfb4 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:45.284377 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 325/645] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:45.290157 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cccf3f-09c6-43e0-8f2d-f87ee5ea6a0a None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:45.394633 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cccf3f-09c6-43e0-8f2d-f87ee5ea6a0a None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:45.413116 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:45.431059 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edc3b8-489e-4814-a563-b513fb2b7942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:45.432047 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edc3b8-489e-4814-a563-b513fb2b7942 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:45.432522 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edc3b8-489e-4814-a563-b513fb2b7942 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:45.433018 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edc3b8-489e-4814-a563-b513fb2b7942 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:45.441008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71edc3b8-489e-4814-a563-b513fb2b7942 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:45.442856 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71edc3b8-489e-4814-a563-b513fb2b7942 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-71edc3b8-489e-4814-a563-b513fb2b7942 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:36:45.454746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:45.455820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:45.456751 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:45.456751 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:45.456751 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:36:45.456751 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:36:45.456751 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:36:45.456751 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:36:45.456751 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:36:45.456751 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:36:45.456751 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:36:45.456751 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:45.459479 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 321/646] 10.222.0.36 () {56 vars in 1093 bytes} [Sat Aug 6 20:36:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:45.465741 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a8269-3085-4424-877e-b342f108bfb4 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:45.572424 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a8269-3085-4424-877e-b342f108bfb4 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:45.601206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:45.609993 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7e102-862c-4b6a-8c60-81c73a7e5947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:45.610786 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7e102-862c-4b6a-8c60-81c73a7e5947 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:45.611931 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7e102-862c-4b6a-8c60-81c73a7e5947 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:45.612222 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7e102-862c-4b6a-8c60-81c73a7e5947 None admin] PATH_INFO: `/v3/users` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:45.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7e102-862c-4b6a-8c60-81c73a7e5947 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:45.613267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7e102-862c-4b6a-8c60-81c73a7e5947 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:45.614713 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7e102-862c-4b6a-8c60-81c73a7e5947 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:45.633095 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 326/647] 10.222.0.36 () {56 vars in 1133 bytes} [Sat Aug 6 20:36:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:45.638848 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edc3b8-489e-4814-a563-b513fb2b7942 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:45.744669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edc3b8-489e-4814-a563-b513fb2b7942 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:45.778690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795de88-80fa-4b81-85be-98c897385725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:45.779301 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795de88-80fa-4b81-85be-98c897385725 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:45.779627 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795de88-80fa-4b81-85be-98c897385725 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:45.779898 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795de88-80fa-4b81-85be-98c897385725 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:45.827103 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:45.851453 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795de88-80fa-4b81-85be-98c897385725 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:45.852947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795de88-80fa-4b81-85be-98c897385725 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:45.964107 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7e102-862c-4b6a-8c60-81c73a7e5947 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:45.973809 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 322/648] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:36:46.068326 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7e102-862c-4b6a-8c60-81c73a7e5947 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:46.103766 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4a1a0-f2e7-43d9-967a-5b58014f1547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:46.104379 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4a1a0-f2e7-43d9-967a-5b58014f1547 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:46.104650 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4a1a0-f2e7-43d9-967a-5b58014f1547 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:46.104913 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4a1a0-f2e7-43d9-967a-5b58014f1547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:46.113146 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53412857-a109-4641-9d28-0409b59f4619 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:46.113429 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53412857-a109-4641-9d28-0409b59f4619 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:46.113704 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53412857-a109-4641-9d28-0409b59f4619 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:46.115289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 323/649] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:36:46.115699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4a1a0-f2e7-43d9-967a-5b58014f1547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:46.117412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4a1a0-f2e7-43d9-967a-5b58014f1547 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:46.121140 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ef866-8287-43b6-b74c-1ce98fb1219a None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:46.121426 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ef866-8287-43b6-b74c-1ce98fb1219a None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:46.121697 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ef866-8287-43b6-b74c-1ce98fb1219a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-b8a4a1a0-f2e7-43d9-967a-5b58014f1547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:46.133824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:46.134876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:46.135773 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:46.135773 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:46.135773 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:46.135773 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 327/650] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:46.141099 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4a1a0-f2e7-43d9-967a-5b58014f1547 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:46.142794 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-af4ef866-8287-43b6-b74c-1ce98fb1219a None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:46.144086 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-af4ef866-8287-43b6-b74c-1ce98fb1219a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:46.181354 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:46.226880 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 324/651] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:46.242111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4a1a0-f2e7-43d9-967a-5b58014f1547 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:46.246043 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ef866-8287-43b6-b74c-1ce98fb1219a None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:46.269382 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:46.278115 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300eb9a-e7eb-4386-aeca-7b802f062398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:46.278774 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300eb9a-e7eb-4386-aeca-7b802f062398 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:46.279048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300eb9a-e7eb-4386-aeca-7b802f062398 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:46.279315 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300eb9a-e7eb-4386-aeca-7b802f062398 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:46.280110 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300eb9a-e7eb-4386-aeca-7b802f062398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:46.280411 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300eb9a-e7eb-4386-aeca-7b802f062398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:46.282367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300eb9a-e7eb-4386-aeca-7b802f062398 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:46.296829 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 328/652] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:46.302328 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300eb9a-e7eb-4386-aeca-7b802f062398 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:46.372679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ef866-8287-43b6-b74c-1ce98fb1219a None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:46.408701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:46.414987 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300eb9a-e7eb-4386-aeca-7b802f062398 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:46.415455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250be35-0656-4f0d-ac07-f54bfe2406ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:46.416108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250be35-0656-4f0d-ac07-f54bfe2406ed None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:46.416379 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250be35-0656-4f0d-ac07-f54bfe2406ed None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:46.416648 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250be35-0656-4f0d-ac07-f54bfe2406ed None admin] PATH_INFO: `/v3/services/image` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:46.417234 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250be35-0656-4f0d-ac07-f54bfe2406ed None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:46.418813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250be35-0656-4f0d-ac07-f54bfe2406ed None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-1250be35-0656-4f0d-ac07-f54bfe2406ed None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:46.432268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:46.433349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:46.434210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:46.434210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:46.434210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:46.434210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:46.434210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:46.434210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:46.434210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:46.434210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:46.434210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:46.434210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:46.434210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:36:46.434210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:46.434210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:36:46.434210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:46.441974 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 325/653] 10.222.0.36 () {56 vars in 1105 bytes} [Sat Aug 6 20:36:46 2022] GET /identity/v3/services/image => generated 86 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:46.443170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250be35-0656-4f0d-ac07-f54bfe2406ed None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:46.458758 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba121053-8baa-42cd-a3f4-55818b75ab5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:46.459653 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba121053-8baa-42cd-a3f4-55818b75ab5d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:46.459925 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba121053-8baa-42cd-a3f4-55818b75ab5d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:46.460306 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba121053-8baa-42cd-a3f4-55818b75ab5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:46.468932 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba121053-8baa-42cd-a3f4-55818b75ab5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:46.470756 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba121053-8baa-42cd-a3f4-55818b75ab5d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:46.487787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-ba121053-8baa-42cd-a3f4-55818b75ab5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:46.487787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:46.487787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:46.487787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:46.487787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:46.487787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:46.487787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:46.487787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:46.487787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:46.487787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:46.487787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:46.487787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:46.487787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:36:46.487787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:36:46.487787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:46.488657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:46.489516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:36:46.489516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:36:46.489516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:36:46.489516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:36:46.489516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:36:46.489516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:36:46.489516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:46.489516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:46.493982 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 329/654] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:46.494924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba121053-8baa-42cd-a3f4-55818b75ab5d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:46.535217 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:46.571658 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250be35-0656-4f0d-ac07-f54bfe2406ed None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:46.616389 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25db2ab-0c5e-4868-ac6a-3e2c132c29ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:46.617557 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25db2ab-0c5e-4868-ac6a-3e2c132c29ef None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:46.618037 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25db2ab-0c5e-4868-ac6a-3e2c132c29ef None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:46.618530 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25db2ab-0c5e-4868-ac6a-3e2c132c29ef None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:46.620237 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25db2ab-0c5e-4868-ac6a-3e2c132c29ef None admin] RBAC: Adding query filter params (name=image) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:46.620971 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25db2ab-0c5e-4868-ac6a-3e2c132c29ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:46.623100 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25db2ab-0c5e-4868-ac6a-3e2c132c29ef None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:46.636273 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 326/655] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:46.637681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25db2ab-0c5e-4868-ac6a-3e2c132c29ef None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:46.640584 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba121053-8baa-42cd-a3f4-55818b75ab5d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:46.691457 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228d919-a0dd-4257-8b41-be2b0bf65a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:46.692614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228d919-a0dd-4257-8b41-be2b0bf65a3b None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:46.693065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228d919-a0dd-4257-8b41-be2b0bf65a3b None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:46.693728 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228d919-a0dd-4257-8b41-be2b0bf65a3b None admin] PATH_INFO: `/v3/projects` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:46.695106 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228d919-a0dd-4257-8b41-be2b0bf65a3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:46.695616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228d919-a0dd-4257-8b41-be2b0bf65a3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:46.697219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228d919-a0dd-4257-8b41-be2b0bf65a3b None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:46.719858 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 330/656] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:46.720830 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228d919-a0dd-4257-8b41-be2b0bf65a3b None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:46.741321 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:46.767692 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25db2ab-0c5e-4868-ac6a-3e2c132c29ef None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:46.808934 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcbd4c-38ab-4781-a6a2-10afb5648119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:46.809898 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcbd4c-38ab-4781-a6a2-10afb5648119 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:46.810186 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcbd4c-38ab-4781-a6a2-10afb5648119 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:46.810516 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcbd4c-38ab-4781-a6a2-10afb5648119 None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:46.811554 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcbd4c-38ab-4781-a6a2-10afb5648119 None admin] RBAC: Adding query filter params (type=image) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:46.812142 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcbd4c-38ab-4781-a6a2-10afb5648119 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:46.813773 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcbd4c-38ab-4781-a6a2-10afb5648119 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:46.818846 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:46.823637 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 327/657] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:46.825107 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8ebd-cfd0-476d-8a9e-39422701b368 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:46.825825 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8ebd-cfd0-476d-8a9e-39422701b368 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:46.826101 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8ebd-cfd0-476d-8a9e-39422701b368 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:46.830643 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 328/658] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:46.833815 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6000e0-a7e3-478e-9a17-e8b800e37aa6 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:46.834565 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6000e0-a7e3-478e-9a17-e8b800e37aa6 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:46.835099 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6000e0-a7e3-478e-9a17-e8b800e37aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:46.850267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228d919-a0dd-4257-8b41-be2b0bf65a3b None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:46.862903 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-0a6000e0-a7e3-478e-9a17-e8b800e37aa6 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:46.864220 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-0a6000e0-a7e3-478e-9a17-e8b800e37aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:46.901731 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c974df1-3725-4f29-b9a2-a1313e68784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:46.902917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c974df1-3725-4f29-b9a2-a1313e68784d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:46.903435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c974df1-3725-4f29-b9a2-a1313e68784d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:46.903898 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c974df1-3725-4f29-b9a2-a1313e68784d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:46.905035 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c974df1-3725-4f29-b9a2-a1313e68784d None admin] RBAC: Adding query filter params (role.id=e62e78acab6b46f6a866b4980700caae, scope.project.id=ce157732829848e59f95d0cd15a897eb, user.id=9f24d354e53845b2a847fdd12077fe61) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:46.905591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c974df1-3725-4f29-b9a2-a1313e68784d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:46.907320 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c974df1-3725-4f29-b9a2-a1313e68784d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:46.915945 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 331/659] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:36:46 2022] GET /identity/v3/role_assignments?user.id=9f24d354e53845b2a847fdd12077fe61&scope.project.id=ce157732829848e59f95d0cd15a897eb&role.id=e62e78acab6b46f6a866b4980700caae => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:46.958826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 329/660] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:46.978338 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c974df1-3725-4f29-b9a2-a1313e68784d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:46.991431 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4358e-1b0e-4a81-a196-46d52b2918af None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:46.991740 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4358e-1b0e-4a81-a196-46d52b2918af None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:46.992300 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4358e-1b0e-4a81-a196-46d52b2918af None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:46.993726 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 330/661] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:46.999637 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2898d4-a5e6-462f-babf-704b5beee440 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:46.999967 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2898d4-a5e6-462f-babf-704b5beee440 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:47.000183 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2898d4-a5e6-462f-babf-704b5beee440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:47.020493 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-be2898d4-a5e6-462f-babf-704b5beee440 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:47.021864 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-be2898d4-a5e6-462f-babf-704b5beee440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:47.083009 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:47.102684 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c974df1-3725-4f29-b9a2-a1313e68784d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:47.112122 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 331/662] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:36:47.135510 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2898d4-a5e6-462f-babf-704b5beee440 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:47.143647 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af0301-caaa-4bc5-a1ff-0ec93813f348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:47.144288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af0301-caaa-4bc5-a1ff-0ec93813f348 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:47.144559 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af0301-caaa-4bc5-a1ff-0ec93813f348 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:47.144823 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af0301-caaa-4bc5-a1ff-0ec93813f348 None admin] PATH_INFO: `/v3/services/network` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:47.145401 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af0301-caaa-4bc5-a1ff-0ec93813f348 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:47.146793 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af0301-caaa-4bc5-a1ff-0ec93813f348 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-33af0301-caaa-4bc5-a1ff-0ec93813f348 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:47.168924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:47.170145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:47.171189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:47.171189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:47.171189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:47.171189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:47.171189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:47.171189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:47.171189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:47.171189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:47.171189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:47.171189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:47.171189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:36:47.171189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:47.171189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:36:47.171189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:47.174119 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 332/663] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:46 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:47.180543 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af0301-caaa-4bc5-a1ff-0ec93813f348 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:47.212557 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:47.256416 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2898d4-a5e6-462f-babf-704b5beee440 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:47.291975 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec298d4-a210-43a5-a655-a8165947da78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:47.292763 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec298d4-a210-43a5-a655-a8165947da78 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:47.293128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec298d4-a210-43a5-a655-a8165947da78 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:47.293508 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec298d4-a210-43a5-a655-a8165947da78 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:47.294189 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec298d4-a210-43a5-a655-a8165947da78 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:47.295676 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec298d4-a210-43a5-a655-a8165947da78 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-1ec298d4-a210-43a5-a655-a8165947da78 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:47.304721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:47.305938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:47.306805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:47.306805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:47.306805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:47.306805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:47.306805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:47.306805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:47.306805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:47.306805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:47.306805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:47.306805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:47.306805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:36:47.306805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:47.306805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:36:47.306805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:47.307549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 332/664] 10.222.0.36 () {56 vars in 1129 bytes} [Sat Aug 6 20:36:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:47.314387 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec298d4-a210-43a5-a655-a8165947da78 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:47.324099 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af0301-caaa-4bc5-a1ff-0ec93813f348 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:47.364916 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1498be1-0c7c-44ee-b40b-7612142c40aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:47.365386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1498be1-0c7c-44ee-b40b-7612142c40aa None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:47.365664 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1498be1-0c7c-44ee-b40b-7612142c40aa None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:47.365932 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1498be1-0c7c-44ee-b40b-7612142c40aa None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:47.366767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1498be1-0c7c-44ee-b40b-7612142c40aa None admin] RBAC: Adding query filter params (name=network) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:47.367256 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1498be1-0c7c-44ee-b40b-7612142c40aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:47.368652 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1498be1-0c7c-44ee-b40b-7612142c40aa None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:47.373831 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 333/665] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Aug 6 20:36:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:47.379275 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1498be1-0c7c-44ee-b40b-7612142c40aa None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:47.402999 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:47.428482 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec298d4-a210-43a5-a655-a8165947da78 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:47.455053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:47.467099 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed881b8d-170e-45aa-a957-5e58e9b3fb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:47.467981 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed881b8d-170e-45aa-a957-5e58e9b3fb2f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:47.468411 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed881b8d-170e-45aa-a957-5e58e9b3fb2f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:47.468815 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed881b8d-170e-45aa-a957-5e58e9b3fb2f None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:47.470040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed881b8d-170e-45aa-a957-5e58e9b3fb2f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:47.470492 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed881b8d-170e-45aa-a957-5e58e9b3fb2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:47.472107 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed881b8d-170e-45aa-a957-5e58e9b3fb2f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:47.479405 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 333/666] 10.222.0.36 () {56 vars in 1124 bytes} [Sat Aug 6 20:36:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:47.485132 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed881b8d-170e-45aa-a957-5e58e9b3fb2f None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:47.489743 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1498be1-0c7c-44ee-b40b-7612142c40aa None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:47.526009 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b54c4-3bf1-4660-a82b-1008025d13af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:47.526802 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b54c4-3bf1-4660-a82b-1008025d13af None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:47.527172 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b54c4-3bf1-4660-a82b-1008025d13af None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:47.527535 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b54c4-3bf1-4660-a82b-1008025d13af None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:47.528255 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b54c4-3bf1-4660-a82b-1008025d13af None admin] RBAC: Adding query filter params (type=network) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:47.528842 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b54c4-3bf1-4660-a82b-1008025d13af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:47.530159 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b54c4-3bf1-4660-a82b-1008025d13af None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:47.541693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 334/667] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Aug 6 20:36:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:47.607391 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed881b8d-170e-45aa-a957-5e58e9b3fb2f None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:47.645837 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66935a-f0af-4e36-a971-2d70cd02768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:47.647006 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66935a-f0af-4e36-a971-2d70cd02768c None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:47.647526 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66935a-f0af-4e36-a971-2d70cd02768c None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:47.648154 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66935a-f0af-4e36-a971-2d70cd02768c None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:47.649422 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66935a-f0af-4e36-a971-2d70cd02768c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:47.649931 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66935a-f0af-4e36-a971-2d70cd02768c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:47.651766 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66935a-f0af-4e36-a971-2d70cd02768c None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:47.657710 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 334/668] 10.222.0.36 () {56 vars in 1124 bytes} [Sat Aug 6 20:36:47 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:49.161622 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec34e68-b1f1-4cd6-9f6d-0ba79221e38b None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:49.162155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec34e68-b1f1-4cd6-9f6d-0ba79221e38b None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:49.162155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec34e68-b1f1-4cd6-9f6d-0ba79221e38b None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:49.163857 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 335/669] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:49.169208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d4a11-cca7-44b3-97f4-9c5739609d12 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:49.169613 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d4a11-cca7-44b3-97f4-9c5739609d12 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:49.169786 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d4a11-cca7-44b3-97f4-9c5739609d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:49.188123 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-609d4a11-cca7-44b3-97f4-9c5739609d12 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:49.189302 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-609d4a11-cca7-44b3-97f4-9c5739609d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:49.236506 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:49.257244 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 335/670] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:49.276854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425c784-385f-46e4-8c37-3a3254cc1a66 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:49.277469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425c784-385f-46e4-8c37-3a3254cc1a66 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:49.277953 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425c784-385f-46e4-8c37-3a3254cc1a66 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:49.279847 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 336/671] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:49.281025 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d4a11-cca7-44b3-97f4-9c5739609d12 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:49.285674 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3f97d-42e2-497d-8ae5-030ff5d40032 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:49.286182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3f97d-42e2-497d-8ae5-030ff5d40032 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:49.286708 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3f97d-42e2-497d-8ae5-030ff5d40032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:49.308369 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-f3f3f97d-42e2-497d-8ae5-030ff5d40032 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:49.309580 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-f3f3f97d-42e2-497d-8ae5-030ff5d40032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:49.378927 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 337/672] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:36:49.390612 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d4a11-cca7-44b3-97f4-9c5739609d12 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:49.403198 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3f97d-42e2-497d-8ae5-030ff5d40032 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:49.406909 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:49.429892 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658d2e1-bc3f-4c0c-b31d-9d5e6f51deac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:49.430889 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658d2e1-bc3f-4c0c-b31d-9d5e6f51deac None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:49.431376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658d2e1-bc3f-4c0c-b31d-9d5e6f51deac None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:49.431855 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658d2e1-bc3f-4c0c-b31d-9d5e6f51deac None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:49.432746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658d2e1-bc3f-4c0c-b31d-9d5e6f51deac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:49.434302 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658d2e1-bc3f-4c0c-b31d-9d5e6f51deac None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:49.454153 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 336/673] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Aug 6 20:36:49 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:36:49.521886 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3f97d-42e2-497d-8ae5-030ff5d40032 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:49.569666 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec572d-098d-47d2-ab24-7e61b6b1a555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:49.570360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec572d-098d-47d2-ab24-7e61b6b1a555 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:49.570664 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec572d-098d-47d2-ab24-7e61b6b1a555 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:49.570935 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec572d-098d-47d2-ab24-7e61b6b1a555 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:49.583213 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec572d-098d-47d2-ab24-7e61b6b1a555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-e7ec572d-098d-47d2-ab24-7e61b6b1a555 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:49.588206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:49.589170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:49.590010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:49.590010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:49.590010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:49.590010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:49.590010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:49.590010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:49.590010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:49.590010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:49.590010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:49.590010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:49.590010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:36:49.590010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:49.590010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 338/674] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:36:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:49.599949 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658d2e1-bc3f-4c0c-b31d-9d5e6f51deac None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:49.649077 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:49.715458 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658d2e1-bc3f-4c0c-b31d-9d5e6f51deac None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:49.752061 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ce779-4192-4c3f-84b5-cb4c7488f99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:49.752671 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ce779-4192-4c3f-84b5-cb4c7488f99d None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:49.752941 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ce779-4192-4c3f-84b5-cb4c7488f99d None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:49.753213 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ce779-4192-4c3f-84b5-cb4c7488f99d None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:49.753874 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ce779-4192-4c3f-84b5-cb4c7488f99d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:49.754169 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ce779-4192-4c3f-84b5-cb4c7488f99d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:49.755570 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ce779-4192-4c3f-84b5-cb4c7488f99d None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:49.769350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 337/675] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:49.770816 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec572d-098d-47d2-ab24-7e61b6b1a555 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:49.833176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:49.880142 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec572d-098d-47d2-ab24-7e61b6b1a555 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:49.881469 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64165db-51a7-4d85-91b0-58c21e2b90f5 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:49.883062 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64165db-51a7-4d85-91b0-58c21e2b90f5 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:49.883062 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64165db-51a7-4d85-91b0-58c21e2b90f5 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:49.884096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 338/676] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:49.889812 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22a82-ffc8-482d-96ea-d612c3f4be39 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:49.890137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22a82-ffc8-482d-96ea-d612c3f4be39 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:49.890362 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22a82-ffc8-482d-96ea-d612c3f4be39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:49.911349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-9ba22a82-ffc8-482d-96ea-d612c3f4be39 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:49.913230 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-9ba22a82-ffc8-482d-96ea-d612c3f4be39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:49.918740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60a970-d15e-46e5-b105-83b9149e37ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:49.919381 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60a970-d15e-46e5-b105-83b9149e37ed None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:49.919656 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60a970-d15e-46e5-b105-83b9149e37ed None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:49.919932 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60a970-d15e-46e5-b105-83b9149e37ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:49.930662 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60a970-d15e-46e5-b105-83b9149e37ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:49.932031 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60a970-d15e-46e5-b105-83b9149e37ed None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-ef60a970-d15e-46e5-b105-83b9149e37ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:49.946735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:49.947767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:49.949001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:49.949001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:49.949001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:49.949001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 339/677] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:49.954859 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60a970-d15e-46e5-b105-83b9149e37ed None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:50.003044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 339/678] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:49 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:36:50.027733 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba22a82-ffc8-482d-96ea-d612c3f4be39 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:50.066082 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:50.076421 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60a970-d15e-46e5-b105-83b9149e37ed None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:50.090176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:50.113425 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00cfd9-b5c8-420a-82c8-730c39a10c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:50.114030 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00cfd9-b5c8-420a-82c8-730c39a10c9e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:50.114304 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00cfd9-b5c8-420a-82c8-730c39a10c9e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:50.114568 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00cfd9-b5c8-420a-82c8-730c39a10c9e None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:50.115230 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00cfd9-b5c8-420a-82c8-730c39a10c9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:50.115527 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00cfd9-b5c8-420a-82c8-730c39a10c9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:50.117154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00cfd9-b5c8-420a-82c8-730c39a10c9e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:50.133854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 340/679] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:50.135274 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512b085-417c-43c8-9d74-9ebb02c52f58 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:50.135548 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512b085-417c-43c8-9d74-9ebb02c52f58 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:50.135885 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512b085-417c-43c8-9d74-9ebb02c52f58 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:50.137206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 341/680] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:50.137806 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512b085-417c-43c8-9d74-9ebb02c52f58 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:50.142492 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba22a82-ffc8-482d-96ea-d612c3f4be39 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:50.179049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c86c20-c16e-47f9-a829-9787f05d083b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:50.179749 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c86c20-c16e-47f9-a829-9787f05d083b None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:50.179975 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c86c20-c16e-47f9-a829-9787f05d083b None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:50.180270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c86c20-c16e-47f9-a829-9787f05d083b None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:50.181373 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c86c20-c16e-47f9-a829-9787f05d083b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:50.183160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c86c20-c16e-47f9-a829-9787f05d083b None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:50.210625 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 340/681] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Aug 6 20:36:50 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:36:50.210625 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe151af-06f2-454d-84a6-6dabb2a12807 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:50.210625 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe151af-06f2-454d-84a6-6dabb2a12807 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:50.210625 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe151af-06f2-454d-84a6-6dabb2a12807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:50.237788 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-fbe151af-06f2-454d-84a6-6dabb2a12807 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:50.239744 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-fbe151af-06f2-454d-84a6-6dabb2a12807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:50.259270 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512b085-417c-43c8-9d74-9ebb02c52f58 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:50.300152 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eef695-e908-437f-b1bf-23dbe5ff3c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:50.300891 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eef695-e908-437f-b1bf-23dbe5ff3c20 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:50.301166 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eef695-e908-437f-b1bf-23dbe5ff3c20 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:50.301481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eef695-e908-437f-b1bf-23dbe5ff3c20 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:50.310206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eef695-e908-437f-b1bf-23dbe5ff3c20 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:50.311975 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eef695-e908-437f-b1bf-23dbe5ff3c20 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-28eef695-e908-437f-b1bf-23dbe5ff3c20 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:36:50.325265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:50.326373 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:50.327671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:50.327671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:50.327671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:36:50.327671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:36:50.327671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:36:50.327671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:36:50.327671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:36:50.327671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:36:50.327671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:36:50.327671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:50.331668 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 342/682] 10.222.0.36 () {56 vars in 1093 bytes} [Sat Aug 6 20:36:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:50.333170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eef695-e908-437f-b1bf-23dbe5ff3c20 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:50.335309 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 341/683] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:50 2022] POST /identity/v3/auth/tokens => generated 994 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:36:50.366498 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe151af-06f2-454d-84a6-6dabb2a12807 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:50.376183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:50.401988 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:50.461333 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eef695-e908-437f-b1bf-23dbe5ff3c20 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:50.510820 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cefb6-f13f-4af6-9035-72c8d3cb170e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:50.511351 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cefb6-f13f-4af6-9035-72c8d3cb170e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:50.511638 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cefb6-f13f-4af6-9035-72c8d3cb170e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:50.511931 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cefb6-f13f-4af6-9035-72c8d3cb170e None admin] PATH_INFO: `/v3/users` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:50.512665 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cefb6-f13f-4af6-9035-72c8d3cb170e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:50.512965 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cefb6-f13f-4af6-9035-72c8d3cb170e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:50.514263 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe151af-06f2-454d-84a6-6dabb2a12807 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:50.514395 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cefb6-f13f-4af6-9035-72c8d3cb170e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:50.534991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 343/684] 10.222.0.36 () {56 vars in 1133 bytes} [Sat Aug 6 20:36:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:50.544086 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cefb6-f13f-4af6-9035-72c8d3cb170e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:50.556133 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86a5ce-d70b-485b-9c1d-8f17c6d35e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:50.557480 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86a5ce-d70b-485b-9c1d-8f17c6d35e4f None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:50.557903 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86a5ce-d70b-485b-9c1d-8f17c6d35e4f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:50.558747 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86a5ce-d70b-485b-9c1d-8f17c6d35e4f None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:50.559907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86a5ce-d70b-485b-9c1d-8f17c6d35e4f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:50.562180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86a5ce-d70b-485b-9c1d-8f17c6d35e4f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:50.582655 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 342/685] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Aug 6 20:36:50 2022] POST /identity/v3/services => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:36:50.665460 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:50.686146 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cefb6-f13f-4af6-9035-72c8d3cb170e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:50.737703 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8538-2651-42cf-b13c-62899dfd84e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:50.738352 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8538-2651-42cf-b13c-62899dfd84e0 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:50.738659 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8538-2651-42cf-b13c-62899dfd84e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:50.738932 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8538-2651-42cf-b13c-62899dfd84e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:50.751149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b8538-2651-42cf-b13c-62899dfd84e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:50.752726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b8538-2651-42cf-b13c-62899dfd84e0 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-b88b8538-2651-42cf-b13c-62899dfd84e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:50.769477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:50.770444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:50.771357 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:50.771357 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:50.771357 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:50.771357 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 344/686] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:50.777043 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86a5ce-d70b-485b-9c1d-8f17c6d35e4f None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:50.875223 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:50.892789 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86a5ce-d70b-485b-9c1d-8f17c6d35e4f None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:50.927070 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be0fae-c2f1-468c-b4e2-784da1c3e511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:50.927678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be0fae-c2f1-468c-b4e2-784da1c3e511 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:50.927952 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be0fae-c2f1-468c-b4e2-784da1c3e511 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:50.928218 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be0fae-c2f1-468c-b4e2-784da1c3e511 None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:50.928925 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be0fae-c2f1-468c-b4e2-784da1c3e511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:50.929224 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be0fae-c2f1-468c-b4e2-784da1c3e511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:50.930608 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be0fae-c2f1-468c-b4e2-784da1c3e511 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:50.942611 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 343/687] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:50.947984 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8538-2651-42cf-b13c-62899dfd84e0 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:51.049739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8538-2651-42cf-b13c-62899dfd84e0 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:51.094861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3430f-8c2a-4e84-a8ff-bbeb0e237155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:51.095491 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3430f-8c2a-4e84-a8ff-bbeb0e237155 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:51.095760 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3430f-8c2a-4e84-a8ff-bbeb0e237155 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:51.096023 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3430f-8c2a-4e84-a8ff-bbeb0e237155 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:51.097926 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:51.104391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3430f-8c2a-4e84-a8ff-bbeb0e237155 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:51.106202 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3430f-8c2a-4e84-a8ff-bbeb0e237155 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:51.118179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-10d3430f-8c2a-4e84-a8ff-bbeb0e237155 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:51.118179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:51.118179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:51.118179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:51.118179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:51.118179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:51.118179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:51.118179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:51.118179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:51.118179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:51.118179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:51.118179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:51.118179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:36:51.118179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:36:51.118179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:51.119138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:51.120024 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:36:51.120024 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:36:51.120024 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:36:51.120024 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:36:51.120024 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:36:51.120024 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:36:51.120024 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:51.120024 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:51.124111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 345/688] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:51.125537 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be0fae-c2f1-468c-b4e2-784da1c3e511 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:51.230980 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be0fae-c2f1-468c-b4e2-784da1c3e511 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:51.267182 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62710dc5-6d30-46d7-9557-54fc979424b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:51.268186 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62710dc5-6d30-46d7-9557-54fc979424b0 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:51.268664 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62710dc5-6d30-46d7-9557-54fc979424b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:51.269131 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62710dc5-6d30-46d7-9557-54fc979424b0 None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:51.270032 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62710dc5-6d30-46d7-9557-54fc979424b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:51.270544 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62710dc5-6d30-46d7-9557-54fc979424b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:51.272210 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62710dc5-6d30-46d7-9557-54fc979424b0 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:51.285147 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 344/689] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:51.291094 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3430f-8c2a-4e84-a8ff-bbeb0e237155 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:51.398325 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3430f-8c2a-4e84-a8ff-bbeb0e237155 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:51.433678 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e1274-2c7f-4994-8574-bb524dba2136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:51.434339 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e1274-2c7f-4994-8574-bb524dba2136 None admin] REQUEST_METHOD: `PUT` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:51.434641 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e1274-2c7f-4994-8574-bb524dba2136 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:51.434921 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e1274-2c7f-4994-8574-bb524dba2136 None admin] PATH_INFO: `/v3/projects/ce157732829848e59f95d0cd15a897eb/users/9f24d354e53845b2a847fdd12077fe61/roles/e62e78acab6b46f6a866b4980700caae` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:51.436919 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e1274-2c7f-4994-8574-bb524dba2136 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce157732829848e59f95d0cd15a897eb, user_id=9f24d354e53845b2a847fdd12077fe61, role_id=e62e78acab6b46f6a866b4980700caae)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:51.438296 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e1274-2c7f-4994-8574-bb524dba2136 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:51.454873 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 346/690] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:36:51 2022] PUT /identity/v3/projects/ce157732829848e59f95d0cd15a897eb/users/9f24d354e53845b2a847fdd12077fe61/roles/e62e78acab6b46f6a866b4980700caae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:36:51.875380 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586f153-0792-43f5-aea9-bb320dd497ee None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:51.875782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586f153-0792-43f5-aea9-bb320dd497ee None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:51.875958 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586f153-0792-43f5-aea9-bb320dd497ee None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:51.877595 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 345/691] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:51.883548 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b323e34-5d8a-42d4-8b17-d6ae0fd840e7 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:51.883872 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b323e34-5d8a-42d4-8b17-d6ae0fd840e7 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:51.884105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b323e34-5d8a-42d4-8b17-d6ae0fd840e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:51.903776 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-6b323e34-5d8a-42d4-8b17-d6ae0fd840e7 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:51.904979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-6b323e34-5d8a-42d4-8b17-d6ae0fd840e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:51.956183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:51.975248 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 347/692] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:51 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:36:51.998417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586f153-0792-43f5-aea9-bb320dd497ee None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:52.003442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:52.113106 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586f153-0792-43f5-aea9-bb320dd497ee None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:52.147926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75705251-6c47-42e6-b303-02008758d2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:52.148486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75705251-6c47-42e6-b303-02008758d2b7 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:52.148758 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75705251-6c47-42e6-b303-02008758d2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:52.149023 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75705251-6c47-42e6-b303-02008758d2b7 None admin] PATH_INFO: `/v3/services/image` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:52.149597 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75705251-6c47-42e6-b303-02008758d2b7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:52.150980 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75705251-6c47-42e6-b303-02008758d2b7 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-75705251-6c47-42e6-b303-02008758d2b7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:52.159853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:52.160923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:52.161761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:52.161761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:52.161761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:52.161761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:52.161761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:52.161761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:52.161761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:52.161761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:52.161761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:52.161761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:52.161761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:36:52.161761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:52.161761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:36:52.161761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:52.161761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 346/693] 10.222.0.36 () {56 vars in 1105 bytes} [Sat Aug 6 20:36:51 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:52.167083 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b323e34-5d8a-42d4-8b17-d6ae0fd840e7 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:52.267705 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b323e34-5d8a-42d4-8b17-d6ae0fd840e7 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:52.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70af03-5aeb-4d51-9a91-0c97fb71605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:52.303227 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70af03-5aeb-4d51-9a91-0c97fb71605f None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:52.303408 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70af03-5aeb-4d51-9a91-0c97fb71605f None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:52.303590 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70af03-5aeb-4d51-9a91-0c97fb71605f None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:52.304283 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70af03-5aeb-4d51-9a91-0c97fb71605f None admin] RBAC: Adding query filter params (name=image) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:52.304583 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70af03-5aeb-4d51-9a91-0c97fb71605f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:52.305965 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70af03-5aeb-4d51-9a91-0c97fb71605f None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:52.310989 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 348/694] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:52.320018 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75705251-6c47-42e6-b303-02008758d2b7 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:52.389770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:52.425618 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75705251-6c47-42e6-b303-02008758d2b7 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:52.466564 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fe0c0-92b6-4d8a-9201-e21575da72be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:52.467314 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe0c0-92b6-4d8a-9201-e21575da72be None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:52.467594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe0c0-92b6-4d8a-9201-e21575da72be None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:52.467858 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe0c0-92b6-4d8a-9201-e21575da72be None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:52.468503 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fe0c0-92b6-4d8a-9201-e21575da72be None admin] RBAC: Adding query filter params (type=image) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:52.468807 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fe0c0-92b6-4d8a-9201-e21575da72be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:52.471236 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fe0c0-92b6-4d8a-9201-e21575da72be None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:52.477706 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 347/695] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:52.484625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70af03-5aeb-4d51-9a91-0c97fb71605f None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:52.541833 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:52.597289 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70af03-5aeb-4d51-9a91-0c97fb71605f None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:52.631640 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355f5fc-f01a-4c3c-bb04-920f87c0875a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:52.632305 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355f5fc-f01a-4c3c-bb04-920f87c0875a None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:52.632581 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355f5fc-f01a-4c3c-bb04-920f87c0875a None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:52.632852 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355f5fc-f01a-4c3c-bb04-920f87c0875a None admin] PATH_INFO: `/v3/endpoints` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:52.633550 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355f5fc-f01a-4c3c-bb04-920f87c0875a None admin] RBAC: Adding query filter params (interface=public, service_id=3ec74f1952d04dee8e95ca4a1722f344, region_id=RegionOne) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:52.633854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355f5fc-f01a-4c3c-bb04-920f87c0875a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:52.635270 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355f5fc-f01a-4c3c-bb04-920f87c0875a None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:52.639261 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191136fe-c65e-4f6b-bc22-4690fa0fa052 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:52.639539 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191136fe-c65e-4f6b-bc22-4690fa0fa052 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:52.639917 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191136fe-c65e-4f6b-bc22-4690fa0fa052 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:52.641516 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 348/696] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:52.643345 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 349/697] 10.222.0.36 () {56 vars in 1251 bytes} [Sat Aug 6 20:36:52 2022] GET /identity/v3/endpoints?service_id=3ec74f1952d04dee8e95ca4a1722f344&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:52.646946 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3acb-5c5c-4fb1-b3dc-6f6bcdba1b7e None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:52.647498 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3acb-5c5c-4fb1-b3dc-6f6bcdba1b7e None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:52.647772 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3acb-5c5c-4fb1-b3dc-6f6bcdba1b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:52.653364 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355f5fc-f01a-4c3c-bb04-920f87c0875a None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:52.666171 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-b33b3acb-5c5c-4fb1-b3dc-6f6bcdba1b7e None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:52.667680 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-b33b3acb-5c5c-4fb1-b3dc-6f6bcdba1b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:52.740972 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 349/698] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:36:52.764757 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b3acb-5c5c-4fb1-b3dc-6f6bcdba1b7e None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:52.777330 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355f5fc-f01a-4c3c-bb04-920f87c0875a None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:52.796051 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:52.826547 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd672a9b-3a97-4322-8238-1cd5ee400762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:52.827806 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd672a9b-3a97-4322-8238-1cd5ee400762 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:52.829120 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd672a9b-3a97-4322-8238-1cd5ee400762 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:52.829535 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd672a9b-3a97-4322-8238-1cd5ee400762 None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:52.830305 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd672a9b-3a97-4322-8238-1cd5ee400762 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:52.831940 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd672a9b-3a97-4322-8238-1cd5ee400762 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:52.847108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 350/699] 10.222.0.36 () {56 vars in 1087 bytes} [Sat Aug 6 20:36:52 2022] GET /identity/v3/services => generated 1002 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:36:52.852577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:52.904561 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b3acb-5c5c-4fb1-b3dc-6f6bcdba1b7e None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:52.960111 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a350941-385c-4c56-b626-757dba89ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:52.960805 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a350941-385c-4c56-b626-757dba89ff3b None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:52.961121 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a350941-385c-4c56-b626-757dba89ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:52.961390 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a350941-385c-4c56-b626-757dba89ff3b None admin] PATH_INFO: `/v3/services/network` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:52.962036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a350941-385c-4c56-b626-757dba89ff3b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:52.965672 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a350941-385c-4c56-b626-757dba89ff3b None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-6a350941-385c-4c56-b626-757dba89ff3b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:52.980344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:52.981385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:52.982207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:52.982207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:52.982207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:52.982207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:52.982207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:52.982207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:52.982207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:52.982207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:52.982207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:52.982207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:52.982207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:36:52.982207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:52.982207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:36:52.982207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:52.987818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 350/700] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:52 2022] GET /identity/v3/services/network => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:53.000427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd672a9b-3a97-4322-8238-1cd5ee400762 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:53.042346 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8348-b74d-40d7-9e4e-07ec910e3b39 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:53.042708 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8348-b74d-40d7-9e4e-07ec910e3b39 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:53.045413 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8348-b74d-40d7-9e4e-07ec910e3b39 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:53.045413 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 351/701] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:53.050610 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71ee49-c01e-429e-aecf-062e0ec6d412 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:53.050610 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71ee49-c01e-429e-aecf-062e0ec6d412 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:53.050610 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71ee49-c01e-429e-aecf-062e0ec6d412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:53.087898 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-7d71ee49-c01e-429e-aecf-062e0ec6d412 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:53.089259 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-7d71ee49-c01e-429e-aecf-062e0ec6d412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:53.160126 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd672a9b-3a97-4322-8238-1cd5ee400762 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:53.170406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 352/702] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:53 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:36:53.202154 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71ee49-c01e-429e-aecf-062e0ec6d412 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:53.206850 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2708c1-8b87-4a11-9760-7b42858b223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:53.207459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2708c1-8b87-4a11-9760-7b42858b223f None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:53.207727 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2708c1-8b87-4a11-9760-7b42858b223f None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:53.207991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2708c1-8b87-4a11-9760-7b42858b223f None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:53.208610 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2708c1-8b87-4a11-9760-7b42858b223f None admin] RBAC: Adding query filter params (name=network) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:53.208903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2708c1-8b87-4a11-9760-7b42858b223f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:53.210677 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2708c1-8b87-4a11-9760-7b42858b223f None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:53.224571 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 351/703] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Aug 6 20:36:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:53.228262 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2708c1-8b87-4a11-9760-7b42858b223f None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:53.291110 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:53.300870 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:53.375043 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2708c1-8b87-4a11-9760-7b42858b223f None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:53.425928 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f85c90-34ab-457c-85f1-0af95ae2a99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:53.426550 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f85c90-34ab-457c-85f1-0af95ae2a99b None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:53.427146 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f85c90-34ab-457c-85f1-0af95ae2a99b None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:53.427583 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f85c90-34ab-457c-85f1-0af95ae2a99b None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:53.428812 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f85c90-34ab-457c-85f1-0af95ae2a99b None admin] RBAC: Adding query filter params (type=network) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:53.430090 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f85c90-34ab-457c-85f1-0af95ae2a99b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:53.431529 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f85c90-34ab-457c-85f1-0af95ae2a99b None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:53.442063 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 352/704] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Aug 6 20:36:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:53.444487 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f85c90-34ab-457c-85f1-0af95ae2a99b None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:53.445813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71ee49-c01e-429e-aecf-062e0ec6d412 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:53.495383 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f17a3-ca25-4a21-9b99-129c7d62fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:53.496460 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f17a3-ca25-4a21-9b99-129c7d62fb04 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:53.496929 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f17a3-ca25-4a21-9b99-129c7d62fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:53.497420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f17a3-ca25-4a21-9b99-129c7d62fb04 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:53.498188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f17a3-ca25-4a21-9b99-129c7d62fb04 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:53.499924 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f17a3-ca25-4a21-9b99-129c7d62fb04 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-537f17a3-ca25-4a21-9b99-129c7d62fb04 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:53.509567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:53.510567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:53.511425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:53.511425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:53.511425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:53.511425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:53.511425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:53.511425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:53.511425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:53.511425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:53.511425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:53.511425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:53.511425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:36:53.511425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:53.511425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:36:53.511425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:53.514422 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 353/705] 10.222.0.36 () {56 vars in 1129 bytes} [Sat Aug 6 20:36:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:53.525731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f17a3-ca25-4a21-9b99-129c7d62fb04 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:53.557382 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f85c90-34ab-457c-85f1-0af95ae2a99b None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:53.560632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:53.601240 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fadb19-bc73-43a8-9376-92c03795372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:53.601857 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fadb19-bc73-43a8-9376-92c03795372d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:53.602129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fadb19-bc73-43a8-9376-92c03795372d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:53.602420 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fadb19-bc73-43a8-9376-92c03795372d None admin] PATH_INFO: `/v3/endpoints` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:53.603312 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fadb19-bc73-43a8-9376-92c03795372d None admin] RBAC: Adding query filter params (interface=public, service_id=b9e2a861a9ec485fac2aab1a7aa31656, region_id=RegionOne) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:53.603621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fadb19-bc73-43a8-9376-92c03795372d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:53.605100 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fadb19-bc73-43a8-9376-92c03795372d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:53.612908 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 353/706] 10.222.0.36 () {56 vars in 1251 bytes} [Sat Aug 6 20:36:53 2022] GET /identity/v3/endpoints?service_id=b9e2a861a9ec485fac2aab1a7aa31656&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:53.618003 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fadb19-bc73-43a8-9376-92c03795372d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:53.649996 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f17a3-ca25-4a21-9b99-129c7d62fb04 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:53.676162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:53.695377 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408de02-6299-4423-85a2-081b710b7542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:53.696185 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408de02-6299-4423-85a2-081b710b7542 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:53.696711 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408de02-6299-4423-85a2-081b710b7542 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:53.697158 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408de02-6299-4423-85a2-081b710b7542 None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:53.697869 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408de02-6299-4423-85a2-081b710b7542 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:53.698281 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408de02-6299-4423-85a2-081b710b7542 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:53.701232 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408de02-6299-4423-85a2-081b710b7542 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:53.712080 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 354/707] 10.222.0.36 () {56 vars in 1124 bytes} [Sat Aug 6 20:36:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:53.713052 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408de02-6299-4423-85a2-081b710b7542 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:53.739976 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fadb19-bc73-43a8-9376-92c03795372d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:53.782976 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d164e-8f34-4160-9ddb-c21dc3dac641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:53.784800 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d164e-8f34-4160-9ddb-c21dc3dac641 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:53.785083 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d164e-8f34-4160-9ddb-c21dc3dac641 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:53.785354 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d164e-8f34-4160-9ddb-c21dc3dac641 None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:53.786012 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d164e-8f34-4160-9ddb-c21dc3dac641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:53.787604 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d164e-8f34-4160-9ddb-c21dc3dac641 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:53.794317 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 354/708] 10.222.0.36 () {56 vars in 1087 bytes} [Sat Aug 6 20:36:53 2022] GET /identity/v3/services => generated 1002 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:36:53.847274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408de02-6299-4423-85a2-081b710b7542 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:53.890968 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5441af-321c-4a9a-8c03-31c63b6f8032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:53.892907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5441af-321c-4a9a-8c03-31c63b6f8032 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:53.892907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5441af-321c-4a9a-8c03-31c63b6f8032 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:53.892907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5441af-321c-4a9a-8c03-31c63b6f8032 None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:53.892907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5441af-321c-4a9a-8c03-31c63b6f8032 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:53.893224 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5441af-321c-4a9a-8c03-31c63b6f8032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:53.894511 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5441af-321c-4a9a-8c03-31c63b6f8032 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:53.900648 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 355/709] 10.222.0.36 () {56 vars in 1124 bytes} [Sat Aug 6 20:36:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:53.908720 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d164e-8f34-4160-9ddb-c21dc3dac641 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:53.943977 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ae57f-080c-4531-b77b-60aec361490e None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:53.944595 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ae57f-080c-4531-b77b-60aec361490e None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:53.944839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ae57f-080c-4531-b77b-60aec361490e None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:53.946831 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:53.947507 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 356/710] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:36:53.954714 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31758c-45b3-4c37-9bc1-e8005397b26e None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:53.955023 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31758c-45b3-4c37-9bc1-e8005397b26e None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:53.955261 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31758c-45b3-4c37-9bc1-e8005397b26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:53.978704 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-ad31758c-45b3-4c37-9bc1-e8005397b26e None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:53.979971 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-ad31758c-45b3-4c37-9bc1-e8005397b26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:54.024765 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d164e-8f34-4160-9ddb-c21dc3dac641 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:54.030700 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:54.064898 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 357/711] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:53 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:36:54.068841 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9e92d-5c61-4e90-b011-85ca8c18b8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:54.069519 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9e92d-5c61-4e90-b011-85ca8c18b8d1 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:54.069793 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9e92d-5c61-4e90-b011-85ca8c18b8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:54.070142 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9e92d-5c61-4e90-b011-85ca8c18b8d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:54.070873 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9e92d-5c61-4e90-b011-85ca8c18b8d1 None admin] RBAC: Adding query filter params (interface=public, service_id=9e70e49efad44cb4a12c76181ca53483, region_id=RegionOne) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:54.071193 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9e92d-5c61-4e90-b011-85ca8c18b8d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:54.072567 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9e92d-5c61-4e90-b011-85ca8c18b8d1 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:54.078386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 355/712] 10.222.0.36 () {56 vars in 1251 bytes} [Sat Aug 6 20:36:53 2022] GET /identity/v3/endpoints?service_id=9e70e49efad44cb4a12c76181ca53483&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:54.083599 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31758c-45b3-4c37-9bc1-e8005397b26e None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:54.091585 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9e92d-5c61-4e90-b011-85ca8c18b8d1 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:54.194900 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31758c-45b3-4c37-9bc1-e8005397b26e None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:54.216071 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:54.225961 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9e92d-5c61-4e90-b011-85ca8c18b8d1 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:54.234432 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146eacc-263b-437d-a604-fd4d7e80a402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:54.235093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146eacc-263b-437d-a604-fd4d7e80a402 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:54.235758 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146eacc-263b-437d-a604-fd4d7e80a402 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:54.235758 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146eacc-263b-437d-a604-fd4d7e80a402 None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:54.236321 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146eacc-263b-437d-a604-fd4d7e80a402 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:54.237698 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146eacc-263b-437d-a604-fd4d7e80a402 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:54.250626 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 358/713] 10.222.0.36 () {56 vars in 1087 bytes} [Sat Aug 6 20:36:54 2022] GET /identity/v3/services => generated 1002 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:36:54.275567 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926ac8-849d-4c83-bc22-024829de873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:54.276214 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926ac8-849d-4c83-bc22-024829de873c None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:54.276489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926ac8-849d-4c83-bc22-024829de873c None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:54.276760 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926ac8-849d-4c83-bc22-024829de873c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:54.289380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21926ac8-849d-4c83-bc22-024829de873c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-21926ac8-849d-4c83-bc22-024829de873c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:36:54.294367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:54.295359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:54.296183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:54.296183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:54.296183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:54.296183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:54.296183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:36:54.296183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:36:54.296183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:36:54.296183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:36:54.296183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:36:54.296183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:36:54.296183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:36:54.296183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:54.296183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 356/714] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:36:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:54.301979 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146eacc-263b-437d-a604-fd4d7e80a402 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:54.354719 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:54.418149 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146eacc-263b-437d-a604-fd4d7e80a402 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:54.457666 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a192b4-6826-41c2-a952-45f9051062a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:54.459137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a192b4-6826-41c2-a952-45f9051062a8 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:54.459623 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a192b4-6826-41c2-a952-45f9051062a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:54.460134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a192b4-6826-41c2-a952-45f9051062a8 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:54.461087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a192b4-6826-41c2-a952-45f9051062a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:54.461618 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a192b4-6826-41c2-a952-45f9051062a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:54.463313 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a192b4-6826-41c2-a952-45f9051062a8 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:54.473574 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 359/715] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:36:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:54.479391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926ac8-849d-4c83-bc22-024829de873c None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:54.585378 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926ac8-849d-4c83-bc22-024829de873c None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:54.620263 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982c889-3304-4512-b301-9de49f5dc850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:54.621290 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982c889-3304-4512-b301-9de49f5dc850 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:54.621760 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982c889-3304-4512-b301-9de49f5dc850 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:54.622242 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982c889-3304-4512-b301-9de49f5dc850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:54.632886 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982c889-3304-4512-b301-9de49f5dc850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:54.634740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982c889-3304-4512-b301-9de49f5dc850 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-b982c889-3304-4512-b301-9de49f5dc850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:54.650380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:54.651400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:54.652268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:54.652268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:54.652268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:54.654358 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 357/716] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:54.659746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a192b4-6826-41c2-a952-45f9051062a8 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:54.767908 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a192b4-6826-41c2-a952-45f9051062a8 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:54.771423 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:54.806275 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d300b6-e473-4f7a-8d22-e1d2ab9bd4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:54.806926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d300b6-e473-4f7a-8d22-e1d2ab9bd4be None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:54.807208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d300b6-e473-4f7a-8d22-e1d2ab9bd4be None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:54.807879 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d300b6-e473-4f7a-8d22-e1d2ab9bd4be None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:54.808128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d300b6-e473-4f7a-8d22-e1d2ab9bd4be None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:54.808393 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d300b6-e473-4f7a-8d22-e1d2ab9bd4be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:54.809748 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d300b6-e473-4f7a-8d22-e1d2ab9bd4be None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:54.826954 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 360/717] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:54.828773 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982c889-3304-4512-b301-9de49f5dc850 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:54.844708 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:54.937889 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982c889-3304-4512-b301-9de49f5dc850 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:54.972985 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329efbe-88f4-42b6-a7a5-e743570e9a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:54.973991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329efbe-88f4-42b6-a7a5-e743570e9a9e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:54.974556 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329efbe-88f4-42b6-a7a5-e743570e9a9e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:54.975062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329efbe-88f4-42b6-a7a5-e743570e9a9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:54.983582 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329efbe-88f4-42b6-a7a5-e743570e9a9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:54.985273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329efbe-88f4-42b6-a7a5-e743570e9a9e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-a329efbe-88f4-42b6-a7a5-e743570e9a9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:36:54.996794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:54.997767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:54.998719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:54.998719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:54.998719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:36:54.998719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:36:54.998719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:36:54.998719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:36:54.998719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:36:54.998719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:36:54.998719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:36:54.998719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:55.001308 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 358/718] 10.222.0.36 () {56 vars in 1093 bytes} [Sat Aug 6 20:36:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:55.010637 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d300b6-e473-4f7a-8d22-e1d2ab9bd4be None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:55.119895 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d300b6-e473-4f7a-8d22-e1d2ab9bd4be None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:55.154817 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5177f93-48b6-4a98-acf0-67f4e4f29140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:55.155428 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5177f93-48b6-4a98-acf0-67f4e4f29140 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:55.155701 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5177f93-48b6-4a98-acf0-67f4e4f29140 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:55.155968 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5177f93-48b6-4a98-acf0-67f4e4f29140 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:55.156692 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5177f93-48b6-4a98-acf0-67f4e4f29140 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:55.156994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5177f93-48b6-4a98-acf0-67f4e4f29140 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:55.158577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5177f93-48b6-4a98-acf0-67f4e4f29140 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:55.179894 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 361/719] 10.222.0.36 () {56 vars in 1133 bytes} [Sat Aug 6 20:36:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:55.185688 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329efbe-88f4-42b6-a7a5-e743570e9a9e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:55.245702 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108da0d4-4079-4ecb-8870-a833a5cc784f None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:55.245979 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108da0d4-4079-4ecb-8870-a833a5cc784f None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:55.246250 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108da0d4-4079-4ecb-8870-a833a5cc784f None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:55.247905 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 362/720] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:36:55.253178 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865c580-8ce1-4d6c-bffe-3843ccd820ea None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:55.253456 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865c580-8ce1-4d6c-bffe-3843ccd820ea None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:55.253726 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865c580-8ce1-4d6c-bffe-3843ccd820ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:55.254342 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:55.275543 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-9865c580-8ce1-4d6c-bffe-3843ccd820ea None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:55.276529 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-9865c580-8ce1-4d6c-bffe-3843ccd820ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:55.290617 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329efbe-88f4-42b6-a7a5-e743570e9a9e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:55.311002 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:55.329070 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28d8eb-f3cc-4202-9606-62ac30c5ef4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:55.329739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28d8eb-f3cc-4202-9606-62ac30c5ef4a None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:55.330014 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28d8eb-f3cc-4202-9606-62ac30c5ef4a None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:55.330280 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28d8eb-f3cc-4202-9606-62ac30c5ef4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:55.366927 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 363/721] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:55 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:36:55.390335 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865c580-8ce1-4d6c-bffe-3843ccd820ea None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:55.408933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28d8eb-f3cc-4202-9606-62ac30c5ef4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:55.410542 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28d8eb-f3cc-4202-9606-62ac30c5ef4a None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:55.499375 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:55.511423 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865c580-8ce1-4d6c-bffe-3843ccd820ea None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:55.543989 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 359/722] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:55 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:36:55.550839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da699f76-98e1-4230-b107-6831376c9c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:55.550839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da699f76-98e1-4230-b107-6831376c9c5b None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:55.550839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da699f76-98e1-4230-b107-6831376c9c5b None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:55.550839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da699f76-98e1-4230-b107-6831376c9c5b None admin] PATH_INFO: `/v3/services/image` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:55.551333 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da699f76-98e1-4230-b107-6831376c9c5b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:55.552636 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da699f76-98e1-4230-b107-6831376c9c5b None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:55.555963 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28d8eb-f3cc-4202-9606-62ac30c5ef4a None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-da699f76-98e1-4230-b107-6831376c9c5b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:55.562678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:55.563681 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:55.564601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:55.564601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:55.564601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:55.564601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:55.564601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:55.564601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:55.564601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:55.564601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:55.564601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:55.564601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:55.564601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:36:55.564601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:55.564601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:36:55.564601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:55.569269 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 364/723] 10.222.0.36 () {56 vars in 1105 bytes} [Sat Aug 6 20:36:55 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:55.570272 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da699f76-98e1-4230-b107-6831376c9c5b None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:55.597832 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:55.688918 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28d8eb-f3cc-4202-9606-62ac30c5ef4a None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:55.689692 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da699f76-98e1-4230-b107-6831376c9c5b None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:55.729534 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d6a7a-2a17-4aae-97f1-83e31c9fa457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:55.729755 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e243c1a-3729-4997-a02a-bd13622167b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:55.730143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d6a7a-2a17-4aae-97f1-83e31c9fa457 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:55.730416 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d6a7a-2a17-4aae-97f1-83e31c9fa457 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:55.730645 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e243c1a-3729-4997-a02a-bd13622167b5 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:55.730752 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d6a7a-2a17-4aae-97f1-83e31c9fa457 None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:55.731087 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e243c1a-3729-4997-a02a-bd13622167b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:55.731340 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d6a7a-2a17-4aae-97f1-83e31c9fa457 None admin] RBAC: Adding query filter params (name=image) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:55.731522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e243c1a-3729-4997-a02a-bd13622167b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:55.731631 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d6a7a-2a17-4aae-97f1-83e31c9fa457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:55.732993 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d6a7a-2a17-4aae-97f1-83e31c9fa457 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:55.743369 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 365/724] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:55.744237 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d6a7a-2a17-4aae-97f1-83e31c9fa457 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:55.746846 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e243c1a-3729-4997-a02a-bd13622167b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:55.749584 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e243c1a-3729-4997-a02a-bd13622167b5 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-5e243c1a-3729-4997-a02a-bd13622167b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:55.767991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:55.769026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:55.769974 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:55.769974 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:55.769974 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:55.770628 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 360/725] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:55.776280 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e243c1a-3729-4997-a02a-bd13622167b5 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:55.805200 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:55.840348 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:55.865415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d6a7a-2a17-4aae-97f1-83e31c9fa457 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:55.900852 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092014e-3417-42bd-bf26-f6350dcc4a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:55.901486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092014e-3417-42bd-bf26-f6350dcc4a46 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:55.901756 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092014e-3417-42bd-bf26-f6350dcc4a46 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:55.902018 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092014e-3417-42bd-bf26-f6350dcc4a46 None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:55.902677 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092014e-3417-42bd-bf26-f6350dcc4a46 None admin] RBAC: Adding query filter params (type=image) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:55.902984 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092014e-3417-42bd-bf26-f6350dcc4a46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:55.904330 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092014e-3417-42bd-bf26-f6350dcc4a46 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:55.914508 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 366/726] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:55.915895 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e243c1a-3729-4997-a02a-bd13622167b5 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:55.916195 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092014e-3417-42bd-bf26-f6350dcc4a46 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:55.963757 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ced114-fc85-4220-b17a-b2cc27ba6332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:55.965275 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ced114-fc85-4220-b17a-b2cc27ba6332 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:55.965717 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ced114-fc85-4220-b17a-b2cc27ba6332 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:55.966131 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ced114-fc85-4220-b17a-b2cc27ba6332 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:55.967393 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ced114-fc85-4220-b17a-b2cc27ba6332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:55.967841 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ced114-fc85-4220-b17a-b2cc27ba6332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:55.970414 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ced114-fc85-4220-b17a-b2cc27ba6332 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:55.987575 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 361/727] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:55.992771 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ced114-fc85-4220-b17a-b2cc27ba6332 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:56.043468 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092014e-3417-42bd-bf26-f6350dcc4a46 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:56.090767 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46c3a9-0630-4598-a026-366610aed936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:56.091958 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46c3a9-0630-4598-a026-366610aed936 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:56.092478 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46c3a9-0630-4598-a026-366610aed936 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:56.093250 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:56.093639 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46c3a9-0630-4598-a026-366610aed936 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:56.095444 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46c3a9-0630-4598-a026-366610aed936 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:56.096483 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46c3a9-0630-4598-a026-366610aed936 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:56.121284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:56.136929 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 367/728] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Aug 6 20:36:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:36:56.137146 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ced114-fc85-4220-b17a-b2cc27ba6332 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:56.187010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850bb92-9a40-40c4-ad01-09a248ab592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:56.187663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850bb92-9a40-40c4-ad01-09a248ab592c None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:56.187943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850bb92-9a40-40c4-ad01-09a248ab592c None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:56.188215 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850bb92-9a40-40c4-ad01-09a248ab592c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:56.196352 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850bb92-9a40-40c4-ad01-09a248ab592c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:56.197957 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850bb92-9a40-40c4-ad01-09a248ab592c None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:56.211322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-2850bb92-9a40-40c4-ad01-09a248ab592c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:56.211322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:56.211322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:56.211322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:56.211322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:56.211322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:56.211322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:56.211322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:56.211322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:56.211322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:56.211322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:56.211322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:56.211322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:36:56.211322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:36:56.211322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:56.212294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:56.213129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:36:56.213129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:36:56.213129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:36:56.213129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:36:56.213129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:36:56.213129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:36:56.213129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:36:56.213129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:56.213129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 362/729] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:56.219357 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46c3a9-0630-4598-a026-366610aed936 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:56.281325 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758766a-7244-4e2f-a056-eadeebd5b892 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:56.281656 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758766a-7244-4e2f-a056-eadeebd5b892 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:56.281867 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758766a-7244-4e2f-a056-eadeebd5b892 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:56.283448 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 363/730] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:36:56.288969 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e542f-fe6f-4354-ad60-c8843b7e45b4 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:56.289255 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e542f-fe6f-4354-ad60-c8843b7e45b4 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:56.289524 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e542f-fe6f-4354-ad60-c8843b7e45b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:56.308863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-6b7e542f-fe6f-4354-ad60-c8843b7e45b4 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:56.310084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-6b7e542f-fe6f-4354-ad60-c8843b7e45b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:56.343801 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46c3a9-0630-4598-a026-366610aed936 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:56.389821 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 364/731] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:56 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:36:56.398145 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4e210-5643-4637-8535-c524f7640cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:56.398876 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4e210-5643-4637-8535-c524f7640cdb None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:56.399167 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4e210-5643-4637-8535-c524f7640cdb None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:56.399473 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4e210-5643-4637-8535-c524f7640cdb None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:56.400179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4e210-5643-4637-8535-c524f7640cdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:56.400481 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4e210-5643-4637-8535-c524f7640cdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:56.401977 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4e210-5643-4637-8535-c524f7640cdb None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:56.414948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 368/732] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:56.417746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e542f-fe6f-4354-ad60-c8843b7e45b4 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:56.420748 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4e210-5643-4637-8535-c524f7640cdb None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:56.490795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:56.509272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:56.536830 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4e210-5643-4637-8535-c524f7640cdb None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:56.554338 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e542f-fe6f-4354-ad60-c8843b7e45b4 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:56.572493 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b267ae-a90b-41d2-963d-789143476f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:56.573122 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b267ae-a90b-41d2-963d-789143476f22 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:56.573405 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b267ae-a90b-41d2-963d-789143476f22 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:56.573673 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b267ae-a90b-41d2-963d-789143476f22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:56.574406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b267ae-a90b-41d2-963d-789143476f22 None admin] RBAC: Adding query filter params (role.id=e62e78acab6b46f6a866b4980700caae, scope.project.id=ce157732829848e59f95d0cd15a897eb, user.id=9f24d354e53845b2a847fdd12077fe61) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:56.574745 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b267ae-a90b-41d2-963d-789143476f22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:56.576173 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b267ae-a90b-41d2-963d-789143476f22 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:56.582612 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 369/733] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:36:56 2022] GET /identity/v3/role_assignments?user.id=9f24d354e53845b2a847fdd12077fe61&scope.project.id=ce157732829848e59f95d0cd15a897eb&role.id=e62e78acab6b46f6a866b4980700caae => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:56.595025 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ded2c9-e176-420e-9f7d-c8b42fbb0328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:56.595677 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ded2c9-e176-420e-9f7d-c8b42fbb0328 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:56.595947 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ded2c9-e176-420e-9f7d-c8b42fbb0328 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:56.596205 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ded2c9-e176-420e-9f7d-c8b42fbb0328 None admin] PATH_INFO: `/v3/services/network` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:56.596791 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ded2c9-e176-420e-9f7d-c8b42fbb0328 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:56.598207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ded2c9-e176-420e-9f7d-c8b42fbb0328 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-41ded2c9-e176-420e-9f7d-c8b42fbb0328 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:56.608390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:56.609455 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:56.610272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:56.610272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:56.610272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:56.610272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:56.610272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:56.610272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:56.610272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:56.610272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:56.610272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:56.610272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:56.610272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:36:56.610272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:56.610272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:36:56.610272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:56.610272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 365/734] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:36:56 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:56.616168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b267ae-a90b-41d2-963d-789143476f22 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:56.638344 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b6806-c2f3-4818-aa80-037522a7a6a2 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:56.638616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b6806-c2f3-4818-aa80-037522a7a6a2 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:56.638888 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b6806-c2f3-4818-aa80-037522a7a6a2 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:56.641339 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 366/735] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:56.647898 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002d9f0-bd26-434c-ba5e-b81df29eaab1 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:56.648533 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002d9f0-bd26-434c-ba5e-b81df29eaab1 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:56.649024 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002d9f0-bd26-434c-ba5e-b81df29eaab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:56.669243 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-7002d9f0-bd26-434c-ba5e-b81df29eaab1 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:56.670891 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-7002d9f0-bd26-434c-ba5e-b81df29eaab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:56.750836 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b267ae-a90b-41d2-963d-789143476f22 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:56.774650 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 367/736] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:56 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:36:56.790356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002d9f0-bd26-434c-ba5e-b81df29eaab1 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:56.802666 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:56.815260 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9448d-49c6-4e22-8ab5-bdddcc0217ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:56.816684 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9448d-49c6-4e22-8ab5-bdddcc0217ad None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:56.816944 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9448d-49c6-4e22-8ab5-bdddcc0217ad None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:56.817206 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9448d-49c6-4e22-8ab5-bdddcc0217ad None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:56.817838 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9448d-49c6-4e22-8ab5-bdddcc0217ad None admin] RBAC: Adding query filter params (name=network) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:56.818131 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9448d-49c6-4e22-8ab5-bdddcc0217ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:56.819557 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9448d-49c6-4e22-8ab5-bdddcc0217ad None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:56.824561 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 370/737] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Aug 6 20:36:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:56.830481 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9448d-49c6-4e22-8ab5-bdddcc0217ad None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:56.870626 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:56.929211 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002d9f0-bd26-434c-ba5e-b81df29eaab1 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:56.959450 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9448d-49c6-4e22-8ab5-bdddcc0217ad None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:56.973672 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff35b0e-4761-4261-b0e3-b8d95dfaa9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:56.974714 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff35b0e-4761-4261-b0e3-b8d95dfaa9b7 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:56.975024 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff35b0e-4761-4261-b0e3-b8d95dfaa9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:56.975297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff35b0e-4761-4261-b0e3-b8d95dfaa9b7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:56.976773 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff35b0e-4761-4261-b0e3-b8d95dfaa9b7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:56.978197 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff35b0e-4761-4261-b0e3-b8d95dfaa9b7 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-eff35b0e-4761-4261-b0e3-b8d95dfaa9b7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:56.992299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:56.993331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:56.994158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:56.994158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:56.994158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:56.994158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:56.994158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:56.994158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:56.994158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:56.994158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:56.994158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:56.994158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:56.994158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:36:56.994158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:56.994158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:36:56.994158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:56.996931 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 368/738] 10.222.0.36 () {56 vars in 1129 bytes} [Sat Aug 6 20:36:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:57.010686 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff35b0e-4761-4261-b0e3-b8d95dfaa9b7 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:57.013093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89767f-56bc-4c2a-9a84-d56901f4e78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:57.013713 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89767f-56bc-4c2a-9a84-d56901f4e78f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:57.013985 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89767f-56bc-4c2a-9a84-d56901f4e78f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:57.014367 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89767f-56bc-4c2a-9a84-d56901f4e78f None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:57.015033 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89767f-56bc-4c2a-9a84-d56901f4e78f None admin] RBAC: Adding query filter params (type=network) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:57.015327 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89767f-56bc-4c2a-9a84-d56901f4e78f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:57.016799 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89767f-56bc-4c2a-9a84-d56901f4e78f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:57.023282 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 371/739] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Aug 6 20:36:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:57.029964 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89767f-56bc-4c2a-9a84-d56901f4e78f None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:57.091771 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:57.142399 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89767f-56bc-4c2a-9a84-d56901f4e78f None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:57.143244 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff35b0e-4761-4261-b0e3-b8d95dfaa9b7 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:57.169182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:57.180201 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bca3d-3ee1-4b41-9bdb-4d23a20b6a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:57.180905 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bca3d-3ee1-4b41-9bdb-4d23a20b6a70 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:57.181251 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bca3d-3ee1-4b41-9bdb-4d23a20b6a70 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:57.181585 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bca3d-3ee1-4b41-9bdb-4d23a20b6a70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:57.182316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bca3d-3ee1-4b41-9bdb-4d23a20b6a70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:57.182840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38430e90-cf1d-4f41-9ae0-66a34ef5d871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:57.183538 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38430e90-cf1d-4f41-9ae0-66a34ef5d871 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:57.183902 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38430e90-cf1d-4f41-9ae0-66a34ef5d871 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:57.184036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bca3d-3ee1-4b41-9bdb-4d23a20b6a70 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:57.184350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38430e90-cf1d-4f41-9ae0-66a34ef5d871 None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:57.185037 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38430e90-cf1d-4f41-9ae0-66a34ef5d871 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:57.185396 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38430e90-cf1d-4f41-9ae0-66a34ef5d871 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:57.186954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38430e90-cf1d-4f41-9ae0-66a34ef5d871 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:57.197044 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 369/740] 10.222.0.36 () {56 vars in 1124 bytes} [Sat Aug 6 20:36:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:57.198779 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38430e90-cf1d-4f41-9ae0-66a34ef5d871 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:57.211221 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 372/741] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Aug 6 20:36:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:36:57.331551 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38430e90-cf1d-4f41-9ae0-66a34ef5d871 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:57.376409 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7d7c4-0582-470d-b139-bbfe6ceee3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:57.377037 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7d7c4-0582-470d-b139-bbfe6ceee3c5 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:57.377375 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7d7c4-0582-470d-b139-bbfe6ceee3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:57.377647 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7d7c4-0582-470d-b139-bbfe6ceee3c5 None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:57.378282 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7d7c4-0582-470d-b139-bbfe6ceee3c5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:57.378578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7d7c4-0582-470d-b139-bbfe6ceee3c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:57.380109 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7d7c4-0582-470d-b139-bbfe6ceee3c5 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:57.390767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 370/742] 10.222.0.36 () {56 vars in 1124 bytes} [Sat Aug 6 20:36:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:57.393217 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bca3d-3ee1-4b41-9bdb-4d23a20b6a70 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:57.516523 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bca3d-3ee1-4b41-9bdb-4d23a20b6a70 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:57.526333 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:57.555054 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5f20d-9f00-407a-9e72-02954ceaee25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:57.555641 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f20d-9f00-407a-9e72-02954ceaee25 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:57.555914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f20d-9f00-407a-9e72-02954ceaee25 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:57.556178 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f20d-9f00-407a-9e72-02954ceaee25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:57.556836 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5f20d-9f00-407a-9e72-02954ceaee25 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:57.558191 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5f20d-9f00-407a-9e72-02954ceaee25 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:57.590226 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 373/743] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Aug 6 20:36:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:36:58.494278 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b575b9-37d4-4ebd-8306-951af4e537b0 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:58.494921 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b575b9-37d4-4ebd-8306-951af4e537b0 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:58.494921 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b575b9-37d4-4ebd-8306-951af4e537b0 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:58.496215 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 371/744] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:58.501564 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bf4b9-e94b-460a-b38b-0e65911cf87d None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:58.501853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bf4b9-e94b-460a-b38b-0e65911cf87d None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:58.502121 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bf4b9-e94b-460a-b38b-0e65911cf87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:58.520481 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-f70bf4b9-e94b-460a-b38b-0e65911cf87d None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:58.521642 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-f70bf4b9-e94b-460a-b38b-0e65911cf87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:58.602154 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 374/745] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:58 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:36:58.625420 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b575b9-37d4-4ebd-8306-951af4e537b0 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:58.683231 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:58.738375 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b575b9-37d4-4ebd-8306-951af4e537b0 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:58.775176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe7ce1-feb0-4bd5-850b-0d0fbe56bb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:58.775834 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe7ce1-feb0-4bd5-850b-0d0fbe56bb86 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:58.776103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe7ce1-feb0-4bd5-850b-0d0fbe56bb86 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:58.776409 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe7ce1-feb0-4bd5-850b-0d0fbe56bb86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:58.854184 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe7ce1-feb0-4bd5-850b-0d0fbe56bb86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:58.855763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe7ce1-feb0-4bd5-850b-0d0fbe56bb86 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:58.905756 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:58.957466 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 372/746] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:36:58 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:36:58.963535 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bf4b9-e94b-460a-b38b-0e65911cf87d None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:58.984609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dc2de-161a-4cc6-a13c-c680e9789114 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:58.984959 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dc2de-161a-4cc6-a13c-c680e9789114 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:58.985153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dc2de-161a-4cc6-a13c-c680e9789114 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:58.986639 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 373/747] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:58.992147 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff04d6-2ef1-4f92-b02f-f4d0e0372ff2 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:58.992355 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff04d6-2ef1-4f92-b02f-f4d0e0372ff2 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:58.992792 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff04d6-2ef1-4f92-b02f-f4d0e0372ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:59.010495 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-b4ff04d6-2ef1-4f92-b02f-f4d0e0372ff2 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:59.011701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-b4ff04d6-2ef1-4f92-b02f-f4d0e0372ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:59.056145 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:59.068275 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bf4b9-e94b-460a-b38b-0e65911cf87d None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:59.085272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 374/748] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:58 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:36:59.105829 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4e920-2ff9-40a0-8db8-8666b3800e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:59.106459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4e920-2ff9-40a0-8db8-8666b3800e96 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:59.106769 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4e920-2ff9-40a0-8db8-8666b3800e96 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:59.107270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4e920-2ff9-40a0-8db8-8666b3800e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:59.108234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff04d6-2ef1-4f92-b02f-f4d0e0372ff2 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:59.117704 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4e920-2ff9-40a0-8db8-8666b3800e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:59.119244 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4e920-2ff9-40a0-8db8-8666b3800e96 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-bcb4e920-2ff9-40a0-8db8-8666b3800e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:36:59.133770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:59.134755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:36:59.135654 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:36:59.135654 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:36:59.135654 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:36:59.135654 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 375/749] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:36:59.140606 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4e920-2ff9-40a0-8db8-8666b3800e96 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:59.192809 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:59.215826 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff04d6-2ef1-4f92-b02f-f4d0e0372ff2 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:59.245317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4e920-2ff9-40a0-8db8-8666b3800e96 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:59.251017 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303c583-862b-418c-841d-24c7f515856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:59.251892 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303c583-862b-418c-841d-24c7f515856e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:59.252397 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303c583-862b-418c-841d-24c7f515856e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:59.252734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303c583-862b-418c-841d-24c7f515856e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:59.253384 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303c583-862b-418c-841d-24c7f515856e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:59.254847 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303c583-862b-418c-841d-24c7f515856e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-1303c583-862b-418c-841d-24c7f515856e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:36:59.264221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:36:59.265154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:36:59.266065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:36:59.266065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:36:59.266065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:36:59.266065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:36:59.266065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:36:59.266065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:36:59.266065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:36:59.266065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:36:59.266065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:36:59.266065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:36:59.266065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:36:59.266065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:36:59.266065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:36:59.266065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:36:59.266065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 375/750] 10.222.0.36 () {56 vars in 1132 bytes} [Sat Aug 6 20:36:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:36:59.272647 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303c583-862b-418c-841d-24c7f515856e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:59.285222 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802326-dbcf-462e-af7b-b61c01cacfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:59.285836 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802326-dbcf-462e-af7b-b61c01cacfba None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:59.286109 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802326-dbcf-462e-af7b-b61c01cacfba None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:59.286378 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802326-dbcf-462e-af7b-b61c01cacfba None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:59.287055 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef802326-dbcf-462e-af7b-b61c01cacfba None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:59.287355 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef802326-dbcf-462e-af7b-b61c01cacfba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:59.288978 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef802326-dbcf-462e-af7b-b61c01cacfba None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:59.302050 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 376/751] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:59.387036 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303c583-862b-418c-841d-24c7f515856e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:59.425019 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50a76d-cb7b-4de3-aae7-432ac2b17156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:59.425640 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50a76d-cb7b-4de3-aae7-432ac2b17156 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:59.425920 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50a76d-cb7b-4de3-aae7-432ac2b17156 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:59.426173 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50a76d-cb7b-4de3-aae7-432ac2b17156 None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:59.426870 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50a76d-cb7b-4de3-aae7-432ac2b17156 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:59.427173 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50a76d-cb7b-4de3-aae7-432ac2b17156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:59.428692 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50a76d-cb7b-4de3-aae7-432ac2b17156 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:59.434497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 376/752] 10.222.0.36 () {56 vars in 1126 bytes} [Sat Aug 6 20:36:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:36:59.440266 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802326-dbcf-462e-af7b-b61c01cacfba None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:36:59.443389 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:59.546237 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802326-dbcf-462e-af7b-b61c01cacfba None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:36:59.584179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3893d7-3f6c-4e89-a9cd-f4afc6eeee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:36:59.584564 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3893d7-3f6c-4e89-a9cd-f4afc6eeee37 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:59.586322 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3893d7-3f6c-4e89-a9cd-f4afc6eeee37 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:59.586322 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3893d7-3f6c-4e89-a9cd-f4afc6eeee37 None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:59.586322 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3893d7-3f6c-4e89-a9cd-f4afc6eeee37 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:36:59.586322 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3893d7-3f6c-4e89-a9cd-f4afc6eeee37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:36:59.587455 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3893d7-3f6c-4e89-a9cd-f4afc6eeee37 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:36:59.592653 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 377/753] 10.222.0.36 () {56 vars in 1126 bytes} [Sat Aug 6 20:36:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:36:59.879640 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edc12f-3e8a-4591-ad1f-7e7b617ca659 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:59.880162 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edc12f-3e8a-4591-ad1f-7e7b617ca659 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:59.880162 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edc12f-3e8a-4591-ad1f-7e7b617ca659 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:59.881464 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 377/754] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:36:59.887051 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f0a93-0b9b-411f-b41a-cc4bfd882294 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:36:59.887477 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f0a93-0b9b-411f-b41a-cc4bfd882294 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:36:59.887646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f0a93-0b9b-411f-b41a-cc4bfd882294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:36:59.906292 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-4d2f0a93-0b9b-411f-b41a-cc4bfd882294 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:36:59.907519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-4d2f0a93-0b9b-411f-b41a-cc4bfd882294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:36:59.980291 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:36:59.989128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 378/755] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:36:59 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:37:00.011992 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edc12f-3e8a-4591-ad1f-7e7b617ca659 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:00.021886 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:00.119445 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edc12f-3e8a-4591-ad1f-7e7b617ca659 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:00.154524 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a77a0-9389-4213-b494-15470bd30b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:00.155094 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a77a0-9389-4213-b494-15470bd30b73 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:00.155366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a77a0-9389-4213-b494-15470bd30b73 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:00.155615 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a77a0-9389-4213-b494-15470bd30b73 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:00.156190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a77a0-9389-4213-b494-15470bd30b73 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:00.157563 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a77a0-9389-4213-b494-15470bd30b73 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-f71a77a0-9389-4213-b494-15470bd30b73 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:00.166418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:00.167435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:00.168276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:00.168276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:00.168276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:00.168276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:00.168276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:00.168276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:00.168276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:00.168276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:00.168276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:00.168276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:00.168276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:37:00.168276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:00.168276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:37:00.168276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:00.169618 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 378/756] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:37:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:00.173437 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f0a93-0b9b-411f-b41a-cc4bfd882294 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:00.272755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f0a93-0b9b-411f-b41a-cc4bfd882294 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:00.307055 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af397c7d-2046-4021-9f40-8516eef26b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:00.307691 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af397c7d-2046-4021-9f40-8516eef26b15 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:00.307997 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af397c7d-2046-4021-9f40-8516eef26b15 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:00.308276 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af397c7d-2046-4021-9f40-8516eef26b15 None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:00.308901 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af397c7d-2046-4021-9f40-8516eef26b15 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:00.309201 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af397c7d-2046-4021-9f40-8516eef26b15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:00.310562 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af397c7d-2046-4021-9f40-8516eef26b15 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:00.315318 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 379/757] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:37:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:00.321188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a77a0-9389-4213-b494-15470bd30b73 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:00.391839 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:00.423735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a77a0-9389-4213-b494-15470bd30b73 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:00.455543 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025012d-221a-4208-8f82-78f275baebd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:00.456133 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025012d-221a-4208-8f82-78f275baebd8 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:00.456403 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025012d-221a-4208-8f82-78f275baebd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:00.456667 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025012d-221a-4208-8f82-78f275baebd8 None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:00.457290 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025012d-221a-4208-8f82-78f275baebd8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:00.457585 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025012d-221a-4208-8f82-78f275baebd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:00.458979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025012d-221a-4208-8f82-78f275baebd8 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:00.463328 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 379/758] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:37:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:01.840843 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bfb49-15f7-49e9-9954-3864ed544b34 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:01.841425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bfb49-15f7-49e9-9954-3864ed544b34 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:01.841425 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bfb49-15f7-49e9-9954-3864ed544b34 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:01.842717 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 380/759] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:01.848270 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771c1f4-ff6d-45c7-8064-0475decd5e8a None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:01.848695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771c1f4-ff6d-45c7-8064-0475decd5e8a None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:01.848894 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771c1f4-ff6d-45c7-8064-0475decd5e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:01.868168 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-0771c1f4-ff6d-45c7-8064-0475decd5e8a None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:01.869346 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-0771c1f4-ff6d-45c7-8064-0475decd5e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:01.937896 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 380/760] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:01 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:37:01.961632 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bfb49-15f7-49e9-9954-3864ed544b34 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:02.027261 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:02.071873 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bfb49-15f7-49e9-9954-3864ed544b34 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:02.107302 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809d8f9-9b67-4a13-a094-80b8803f746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:02.107825 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809d8f9-9b67-4a13-a094-80b8803f746e None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:02.108105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809d8f9-9b67-4a13-a094-80b8803f746e None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:02.108369 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809d8f9-9b67-4a13-a094-80b8803f746e None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:02.109008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809d8f9-9b67-4a13-a094-80b8803f746e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:02.110391 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809d8f9-9b67-4a13-a094-80b8803f746e None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:02.127588 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 381/761] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Aug 6 20:37:01 2022] POST /identity/v3/services => generated 269 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:02.663332 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e51da-7538-4a13-b2fa-f175eb21fa94 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:02.663332 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e51da-7538-4a13-b2fa-f175eb21fa94 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:02.664075 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e51da-7538-4a13-b2fa-f175eb21fa94 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:02.665166 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 381/762] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:02.670853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6bf8c-df09-4723-8150-b192f8338cf6 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:02.671139 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6bf8c-df09-4723-8150-b192f8338cf6 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:02.671407 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6bf8c-df09-4723-8150-b192f8338cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:02.690910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-85b6bf8c-df09-4723-8150-b192f8338cf6 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:02.692115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-85b6bf8c-df09-4723-8150-b192f8338cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:02.768443 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 382/763] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:02 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:37:02.791943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e51da-7538-4a13-b2fa-f175eb21fa94 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:02.857809 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:02.898378 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e51da-7538-4a13-b2fa-f175eb21fa94 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:02.937229 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb223fdb-09a9-4fa6-9da6-6626d43a9156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:02.937830 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223fdb-09a9-4fa6-9da6-6626d43a9156 None admin] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:02.938104 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223fdb-09a9-4fa6-9da6-6626d43a9156 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:02.938367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223fdb-09a9-4fa6-9da6-6626d43a9156 None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:02.939021 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb223fdb-09a9-4fa6-9da6-6626d43a9156 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:02.940396 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb223fdb-09a9-4fa6-9da6-6626d43a9156 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:02.958731 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 382/764] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Aug 6 20:37:02 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:04.329315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae0f7b-846a-4204-a3b5-05cac6f98f51 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.329875 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae0f7b-846a-4204-a3b5-05cac6f98f51 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.329875 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae0f7b-846a-4204-a3b5-05cac6f98f51 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.331196 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 383/765] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:04.336798 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6472bc-ef27-4c54-a20e-3fc31946e2fe None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.337249 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6472bc-ef27-4c54-a20e-3fc31946e2fe None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.337338 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6472bc-ef27-4c54-a20e-3fc31946e2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.357083 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-ff6472bc-ef27-4c54-a20e-3fc31946e2fe None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.358279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-ff6472bc-ef27-4c54-a20e-3fc31946e2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.433308 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 383/766] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:37:04.456870 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae0f7b-846a-4204-a3b5-05cac6f98f51 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.512263 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:04.566318 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae0f7b-846a-4204-a3b5-05cac6f98f51 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:04.601159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016241f4-21c8-4f6b-b1a5-b15465977f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:04.601710 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016241f4-21c8-4f6b-b1a5-b15465977f31 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.601982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016241f4-21c8-4f6b-b1a5-b15465977f31 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.602247 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016241f4-21c8-4f6b-b1a5-b15465977f31 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.602859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016241f4-21c8-4f6b-b1a5-b15465977f31 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:04.604250 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016241f4-21c8-4f6b-b1a5-b15465977f31 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-016241f4-21c8-4f6b-b1a5-b15465977f31 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:04.613120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:04.614170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:04.615110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:04.615110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:04.615110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:04.615110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:04.615110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:04.615110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:04.615110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:04.615110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:04.615110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:04.615110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:04.615110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:37:04.615110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:04.615110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:37:04.615110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:04.615110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 384/767] 10.222.0.36 () {56 vars in 1132 bytes} [Sat Aug 6 20:37:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:04.620463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6472bc-ef27-4c54-a20e-3fc31946e2fe None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.687818 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:04.737924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6472bc-ef27-4c54-a20e-3fc31946e2fe None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:04.772638 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1dd22-5a66-4688-b8b0-7c8e3e2239b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:04.773237 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1dd22-5a66-4688-b8b0-7c8e3e2239b2 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.773515 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1dd22-5a66-4688-b8b0-7c8e3e2239b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.773781 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1dd22-5a66-4688-b8b0-7c8e3e2239b2 None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.774408 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1dd22-5a66-4688-b8b0-7c8e3e2239b2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:04.774737 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1dd22-5a66-4688-b8b0-7c8e3e2239b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:04.776114 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1dd22-5a66-4688-b8b0-7c8e3e2239b2 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:04.781233 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 384/768] 10.222.0.36 () {56 vars in 1126 bytes} [Sat Aug 6 20:37:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:04.786804 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016241f4-21c8-4f6b-b1a5-b15465977f31 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.893871 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016241f4-21c8-4f6b-b1a5-b15465977f31 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:04.904297 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:04.934695 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5cb28-0293-4924-a90f-d7c53959e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:04.935307 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5cb28-0293-4924-a90f-d7c53959e9aa None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.935582 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5cb28-0293-4924-a90f-d7c53959e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.935851 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5cb28-0293-4924-a90f-d7c53959e9aa None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.936480 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5cb28-0293-4924-a90f-d7c53959e9aa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:04.936776 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5cb28-0293-4924-a90f-d7c53959e9aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:04.938143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5cb28-0293-4924-a90f-d7c53959e9aa None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:04.943206 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 385/769] 10.222.0.36 () {56 vars in 1126 bytes} [Sat Aug 6 20:37:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:04.949378 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1dd22-5a66-4688-b8b0-7c8e3e2239b2 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.052091 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1dd22-5a66-4688-b8b0-7c8e3e2239b2 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.068056 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:05.088700 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb163f21-b5b8-4324-bc83-28b3a12d6d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.089307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb163f21-b5b8-4324-bc83-28b3a12d6d19 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.089578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb163f21-b5b8-4324-bc83-28b3a12d6d19 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.089840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb163f21-b5b8-4324-bc83-28b3a12d6d19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.090541 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb163f21-b5b8-4324-bc83-28b3a12d6d19 None admin] RBAC: Adding query filter params (interface=public, service_id=ef0a4760a2c2475590d2af503473bb8d, region_id=RegionOne) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:05.090856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb163f21-b5b8-4324-bc83-28b3a12d6d19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.092209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb163f21-b5b8-4324-bc83-28b3a12d6d19 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.097624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 385/770] 10.222.0.36 () {56 vars in 1251 bytes} [Sat Aug 6 20:37:04 2022] GET /identity/v3/endpoints?service_id=ef0a4760a2c2475590d2af503473bb8d&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:05.103537 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5cb28-0293-4924-a90f-d7c53959e9aa None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.194759 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722d034-68ad-499d-acb5-8c578805b6be None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.194940 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722d034-68ad-499d-acb5-8c578805b6be None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.195213 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722d034-68ad-499d-acb5-8c578805b6be None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.196561 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 386/771] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:05.201591 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986de2be-a78b-4b0f-a44f-92a8a8b4f034 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.201870 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986de2be-a78b-4b0f-a44f-92a8a8b4f034 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.202139 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986de2be-a78b-4b0f-a44f-92a8a8b4f034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.204318 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5cb28-0293-4924-a90f-d7c53959e9aa None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.220906 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-986de2be-a78b-4b0f-a44f-92a8a8b4f034 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:05.222085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-986de2be-a78b-4b0f-a44f-92a8a8b4f034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:05.238300 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e47c9-055c-4fd8-aa9a-29040ad7dd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.238939 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e47c9-055c-4fd8-aa9a-29040ad7dd89 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.239214 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e47c9-055c-4fd8-aa9a-29040ad7dd89 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.239478 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e47c9-055c-4fd8-aa9a-29040ad7dd89 None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.240078 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e47c9-055c-4fd8-aa9a-29040ad7dd89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.241685 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e47c9-055c-4fd8-aa9a-29040ad7dd89 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.247420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 386/772] 10.222.0.36 () {56 vars in 1087 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:37:05.293623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 387/773] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:05 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:37:05.317441 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e47c9-055c-4fd8-aa9a-29040ad7dd89 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.360561 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:05.426318 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e47c9-055c-4fd8-aa9a-29040ad7dd89 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.462196 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942de9e-e4b7-4d75-803b-528cb06adf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.462771 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942de9e-e4b7-4d75-803b-528cb06adf8a None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.463043 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942de9e-e4b7-4d75-803b-528cb06adf8a None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.463307 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942de9e-e4b7-4d75-803b-528cb06adf8a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.463880 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942de9e-e4b7-4d75-803b-528cb06adf8a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.465235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942de9e-e4b7-4d75-803b-528cb06adf8a None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-0942de9e-e4b7-4d75-803b-528cb06adf8a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:05.475679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:05.476657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:05.477497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:05.477497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:05.477497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:05.477497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:05.477497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:05.477497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:05.477497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:05.477497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:05.477497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:05.477497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:05.477497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:37:05.477497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:05.477497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:37:05.477497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:05.477497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 387/774] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:05.483510 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986de2be-a78b-4b0f-a44f-92a8a8b4f034 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.580627 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986de2be-a78b-4b0f-a44f-92a8a8b4f034 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.589949 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:05.615224 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64567e31-7ee3-4e19-b76b-ab06073f7ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.615902 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64567e31-7ee3-4e19-b76b-ab06073f7ba2 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.616219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64567e31-7ee3-4e19-b76b-ab06073f7ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.616482 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64567e31-7ee3-4e19-b76b-ab06073f7ba2 None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.617104 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64567e31-7ee3-4e19-b76b-ab06073f7ba2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:05.617402 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64567e31-7ee3-4e19-b76b-ab06073f7ba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.618791 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64567e31-7ee3-4e19-b76b-ab06073f7ba2 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.623449 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 388/775] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:05.629245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942de9e-e4b7-4d75-803b-528cb06adf8a None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.732460 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942de9e-e4b7-4d75-803b-528cb06adf8a None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.734104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:05.767422 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14771408-a73a-4a97-9ea7-3c93245e54ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.768028 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14771408-a73a-4a97-9ea7-3c93245e54ed None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.768301 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14771408-a73a-4a97-9ea7-3c93245e54ed None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.768569 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14771408-a73a-4a97-9ea7-3c93245e54ed None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.769188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14771408-a73a-4a97-9ea7-3c93245e54ed None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:05.769484 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14771408-a73a-4a97-9ea7-3c93245e54ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.770876 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14771408-a73a-4a97-9ea7-3c93245e54ed None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.776004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 388/776] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:05.781999 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64567e31-7ee3-4e19-b76b-ab06073f7ba2 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.885399 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64567e31-7ee3-4e19-b76b-ab06073f7ba2 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.918923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97332c-9929-4873-a5f6-7fa55d94bb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.919522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97332c-9929-4873-a5f6-7fa55d94bb79 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.919791 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97332c-9929-4873-a5f6-7fa55d94bb79 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.920052 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97332c-9929-4873-a5f6-7fa55d94bb79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.920734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97332c-9929-4873-a5f6-7fa55d94bb79 None admin] RBAC: Adding query filter params (interface=public, service_id=a2fb7cbff2e345b8aee22f82eaaeb19d, region_id=RegionOne) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:05.921034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97332c-9929-4873-a5f6-7fa55d94bb79 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.922381 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97332c-9929-4873-a5f6-7fa55d94bb79 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.927311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 389/777] 10.222.0.36 () {56 vars in 1251 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/endpoints?service_id=a2fb7cbff2e345b8aee22f82eaaeb19d&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:05.933951 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14771408-a73a-4a97-9ea7-3c93245e54ed None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.033660 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14771408-a73a-4a97-9ea7-3c93245e54ed None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.067064 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ba2e5-3297-48f2-bd24-1f954ffcc962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.067666 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ba2e5-3297-48f2-bd24-1f954ffcc962 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.067942 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ba2e5-3297-48f2-bd24-1f954ffcc962 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.068211 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ba2e5-3297-48f2-bd24-1f954ffcc962 None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.068857 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ba2e5-3297-48f2-bd24-1f954ffcc962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.070231 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ba2e5-3297-48f2-bd24-1f954ffcc962 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.075968 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 389/778] 10.222.0.36 () {56 vars in 1087 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/services => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:07.452725 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d82ea-2a43-4f91-9973-1ca3311792bf None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:07.453287 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d82ea-2a43-4f91-9973-1ca3311792bf None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:07.453287 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d82ea-2a43-4f91-9973-1ca3311792bf None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:07.454576 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 390/779] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:07.459914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1d01e-c45f-4b5d-b5d8-2bb58cb43cc2 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:07.460373 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1d01e-c45f-4b5d-b5d8-2bb58cb43cc2 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:07.460468 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1d01e-c45f-4b5d-b5d8-2bb58cb43cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:07.482044 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-f5d1d01e-c45f-4b5d-b5d8-2bb58cb43cc2 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:07.483271 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-f5d1d01e-c45f-4b5d-b5d8-2bb58cb43cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:07.509302 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:07.555171 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 390/780] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:07 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:37:07.579042 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d82ea-2a43-4f91-9973-1ca3311792bf None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:07.617776 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:07.686026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d82ea-2a43-4f91-9973-1ca3311792bf None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:07.723101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f4561-1290-4ab7-99ef-18cfedb4d006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:07.723676 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f4561-1290-4ab7-99ef-18cfedb4d006 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:07.723946 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f4561-1290-4ab7-99ef-18cfedb4d006 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:07.724211 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f4561-1290-4ab7-99ef-18cfedb4d006 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:07.724787 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f4561-1290-4ab7-99ef-18cfedb4d006 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:07.726825 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f4561-1290-4ab7-99ef-18cfedb4d006 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-850f4561-1290-4ab7-99ef-18cfedb4d006 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:07.735687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:07.736613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:07.737467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:07.737467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:07.737467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:07.737467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:07.737467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:07.737467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:07.737467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:07.737467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:07.737467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:07.737467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:07.737467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:37:07.737467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:07.737467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:37:07.737467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:07.737467 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 391/781] 10.222.0.36 () {56 vars in 1132 bytes} [Sat Aug 6 20:37:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:07.743192 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1d01e-c45f-4b5d-b5d8-2bb58cb43cc2 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:07.844143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1d01e-c45f-4b5d-b5d8-2bb58cb43cc2 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:07.880923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d726d62-3f0e-4a5f-80c4-b49c195b8f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:07.881575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d726d62-3f0e-4a5f-80c4-b49c195b8f04 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:07.882049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d726d62-3f0e-4a5f-80c4-b49c195b8f04 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:07.882196 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d726d62-3f0e-4a5f-80c4-b49c195b8f04 None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:07.886037 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d726d62-3f0e-4a5f-80c4-b49c195b8f04 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:07.886037 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d726d62-3f0e-4a5f-80c4-b49c195b8f04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:07.886037 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d726d62-3f0e-4a5f-80c4-b49c195b8f04 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:07.889834 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 391/782] 10.222.0.36 () {56 vars in 1126 bytes} [Sat Aug 6 20:37:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:07.895554 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f4561-1290-4ab7-99ef-18cfedb4d006 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:07.997966 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:08.000794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f4561-1290-4ab7-99ef-18cfedb4d006 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:08.036606 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428ffa9-5aa3-4ff9-9b72-663ee7129a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:08.037206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428ffa9-5aa3-4ff9-9b72-663ee7129a99 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.037476 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428ffa9-5aa3-4ff9-9b72-663ee7129a99 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.037766 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428ffa9-5aa3-4ff9-9b72-663ee7129a99 None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.038471 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428ffa9-5aa3-4ff9-9b72-663ee7129a99 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:08.038792 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428ffa9-5aa3-4ff9-9b72-663ee7129a99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:08.040174 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428ffa9-5aa3-4ff9-9b72-663ee7129a99 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:08.044964 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 392/783] 10.222.0.36 () {56 vars in 1126 bytes} [Sat Aug 6 20:37:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:08.050808 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d726d62-3f0e-4a5f-80c4-b49c195b8f04 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:08.076469 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:08.154072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d726d62-3f0e-4a5f-80c4-b49c195b8f04 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:08.187939 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7708b-6eb6-44d2-8cbe-6f32011267e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:08.188536 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7708b-6eb6-44d2-8cbe-6f32011267e2 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.188808 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7708b-6eb6-44d2-8cbe-6f32011267e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.189070 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7708b-6eb6-44d2-8cbe-6f32011267e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.189713 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7708b-6eb6-44d2-8cbe-6f32011267e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:08.191106 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7708b-6eb6-44d2-8cbe-6f32011267e2 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:08.211987 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 392/784] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:08.265833 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453957f-c179-4dd3-86b9-3abb724dd25a None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.266023 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453957f-c179-4dd3-86b9-3abb724dd25a None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.266281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453957f-c179-4dd3-86b9-3abb724dd25a None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.267855 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 393/785] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:08.274307 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83027f-e5cc-4960-a7d9-8e3334b3c37a None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.274628 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83027f-e5cc-4960-a7d9-8e3334b3c37a None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.274899 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83027f-e5cc-4960-a7d9-8e3334b3c37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.294613 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-4c83027f-e5cc-4960-a7d9-8e3334b3c37a None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:08.295864 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-4c83027f-e5cc-4960-a7d9-8e3334b3c37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:08.376636 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 393/786] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:08 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:37:08.402010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453957f-c179-4dd3-86b9-3abb724dd25a None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:08.513965 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453957f-c179-4dd3-86b9-3abb724dd25a None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:08.548277 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc38365-b0c8-41a0-b6b5-969ee9c5f11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:08.548832 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc38365-b0c8-41a0-b6b5-969ee9c5f11c None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.549108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc38365-b0c8-41a0-b6b5-969ee9c5f11c None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.549378 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc38365-b0c8-41a0-b6b5-969ee9c5f11c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.550011 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc38365-b0c8-41a0-b6b5-969ee9c5f11c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:08.551413 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc38365-b0c8-41a0-b6b5-969ee9c5f11c None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-9bc38365-b0c8-41a0-b6b5-969ee9c5f11c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:08.561149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:08.562221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:08.563281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:08.563281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:08.563281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:08.563281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:08.563281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:08.563281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:08.563281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:08.563281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:08.563281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:08.563281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:08.563281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:37:08.563281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:08.563281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:37:08.563281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:08.563281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 394/787] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:37:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:08.568420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83027f-e5cc-4960-a7d9-8e3334b3c37a None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:08.577377 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:08.671741 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83027f-e5cc-4960-a7d9-8e3334b3c37a None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:08.705821 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdf80f-eb90-415e-a9cc-f52ce50e50e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:08.706429 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdf80f-eb90-415e-a9cc-f52ce50e50e6 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.706733 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdf80f-eb90-415e-a9cc-f52ce50e50e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.707001 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdf80f-eb90-415e-a9cc-f52ce50e50e6 None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.707629 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdf80f-eb90-415e-a9cc-f52ce50e50e6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:08.707926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdf80f-eb90-415e-a9cc-f52ce50e50e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:08.709291 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdf80f-eb90-415e-a9cc-f52ce50e50e6 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:08.715115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 394/788] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:37:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:08.721367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc38365-b0c8-41a0-b6b5-969ee9c5f11c None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:08.751756 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:08.825547 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc38365-b0c8-41a0-b6b5-969ee9c5f11c None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:08.859474 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502e790-135f-4b67-ac6e-4a931dbcf320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:08.860078 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502e790-135f-4b67-ac6e-4a931dbcf320 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.860376 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502e790-135f-4b67-ac6e-4a931dbcf320 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.860626 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502e790-135f-4b67-ac6e-4a931dbcf320 None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.861247 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502e790-135f-4b67-ac6e-4a931dbcf320 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:08.861550 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502e790-135f-4b67-ac6e-4a931dbcf320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:08.862955 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502e790-135f-4b67-ac6e-4a931dbcf320 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:08.868083 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 395/789] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Aug 6 20:37:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:08.874057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdf80f-eb90-415e-a9cc-f52ce50e50e6 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:08.948709 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:08.982546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdf80f-eb90-415e-a9cc-f52ce50e50e6 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:09.017819 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd04f3-f616-4a11-a0b2-732354bbec69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:09.018422 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd04f3-f616-4a11-a0b2-732354bbec69 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:09.018721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd04f3-f616-4a11-a0b2-732354bbec69 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:09.018994 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd04f3-f616-4a11-a0b2-732354bbec69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:09.019650 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd04f3-f616-4a11-a0b2-732354bbec69 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:09.021008 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd04f3-f616-4a11-a0b2-732354bbec69 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:09.042203 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 395/790] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:10.420880 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f36158-28c0-4709-a462-2e753185ba59 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:10.421529 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f36158-28c0-4709-a462-2e753185ba59 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:10.421529 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f36158-28c0-4709-a462-2e753185ba59 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:10.422907 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 396/791] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:10.428609 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f354c-1f62-4081-a51a-b522bfaa6248 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:10.429066 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f354c-1f62-4081-a51a-b522bfaa6248 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:10.429165 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f354c-1f62-4081-a51a-b522bfaa6248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:10.447464 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-8a3f354c-1f62-4081-a51a-b522bfaa6248 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:10.448621 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-8a3f354c-1f62-4081-a51a-b522bfaa6248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:10.527574 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 396/792] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:10 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:37:10.551118 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f36158-28c0-4709-a462-2e753185ba59 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:10.649328 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:10.660149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f36158-28c0-4709-a462-2e753185ba59 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:10.694853 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e2309-5647-4ff7-8a8f-8f0275e0b8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:10.695401 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2309-5647-4ff7-8a8f-8f0275e0b8d4 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:10.695671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2309-5647-4ff7-8a8f-8f0275e0b8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:10.695930 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2309-5647-4ff7-8a8f-8f0275e0b8d4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:10.696500 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e2309-5647-4ff7-8a8f-8f0275e0b8d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:10.697869 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e2309-5647-4ff7-8a8f-8f0275e0b8d4 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-e29e2309-5647-4ff7-8a8f-8f0275e0b8d4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:10.706612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:10.707634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:10.708521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:10.708521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:10.708521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:10.708521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:10.708521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:10.708521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:10.708521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:10.708521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:10.708521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:10.708521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:10.708521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:37:10.708521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:10.708521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:37:10.708521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:10.708521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 397/793] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:37:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:10.714135 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f354c-1f62-4081-a51a-b522bfaa6248 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:10.767475 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:10.816054 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f354c-1f62-4081-a51a-b522bfaa6248 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:10.871684 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3cdc5-4fb6-4eb0-bb16-803d9d7c3bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:10.872305 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3cdc5-4fb6-4eb0-bb16-803d9d7c3bdb None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:10.872574 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3cdc5-4fb6-4eb0-bb16-803d9d7c3bdb None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:10.872837 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3cdc5-4fb6-4eb0-bb16-803d9d7c3bdb None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:10.873473 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3cdc5-4fb6-4eb0-bb16-803d9d7c3bdb None admin] RBAC: Adding query filter params (name=compute) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:10.873788 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3cdc5-4fb6-4eb0-bb16-803d9d7c3bdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:10.875176 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3cdc5-4fb6-4eb0-bb16-803d9d7c3bdb None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:10.879910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 397/794] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Aug 6 20:37:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:10.886328 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e2309-5647-4ff7-8a8f-8f0275e0b8d4 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:10.992355 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e2309-5647-4ff7-8a8f-8f0275e0b8d4 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:11.029389 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2818db-834e-4cdf-8fe8-5080cc8854a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:11.029991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2818db-834e-4cdf-8fe8-5080cc8854a0 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:11.030264 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2818db-834e-4cdf-8fe8-5080cc8854a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:11.030529 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2818db-834e-4cdf-8fe8-5080cc8854a0 None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:11.031177 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2818db-834e-4cdf-8fe8-5080cc8854a0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:11.031470 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2818db-834e-4cdf-8fe8-5080cc8854a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:11.032850 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2818db-834e-4cdf-8fe8-5080cc8854a0 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:11.037511 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 398/795] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Aug 6 20:37:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:11.270536 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa5e53-995d-4fc5-954a-202d09c22a9e None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:11.270753 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa5e53-995d-4fc5-954a-202d09c22a9e None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:11.271019 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa5e53-995d-4fc5-954a-202d09c22a9e None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:11.272374 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 398/796] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:11.277917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16bf8-3f25-4ceb-ab62-85e86a4871eb None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:11.278270 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16bf8-3f25-4ceb-ab62-85e86a4871eb None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:11.278547 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16bf8-3f25-4ceb-ab62-85e86a4871eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:11.297048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-39d16bf8-3f25-4ceb-ab62-85e86a4871eb None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:11.298230 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-39d16bf8-3f25-4ceb-ab62-85e86a4871eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:11.313081 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:11.369733 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 399/797] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:11 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:37:11.394250 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa5e53-995d-4fc5-954a-202d09c22a9e None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:11.503908 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa5e53-995d-4fc5-954a-202d09c22a9e None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:11.529692 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:11.559520 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30758204-17b2-474a-bc04-29345a121d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:11.560130 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30758204-17b2-474a-bc04-29345a121d56 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:11.560401 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30758204-17b2-474a-bc04-29345a121d56 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:11.560663 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30758204-17b2-474a-bc04-29345a121d56 None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:11.561292 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30758204-17b2-474a-bc04-29345a121d56 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:11.562742 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30758204-17b2-474a-bc04-29345a121d56 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:11.565554 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: WARNING keystone.server.flask.common [None req-30758204-17b2-474a-bc04-29345a121d56 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 06 20:37:11.588306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.sql.core [None req-30758204-17b2-474a-bc04-29345a121d56 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 06 20:37:11.588306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 06 20:37:11.588306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [parameters: {'id': '39c4e2566e814077b635b0048c827674', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 06 20:37:11.588306 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93752) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 20:37:11.605284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-30758204-17b2-474a-bc04-29345a121d56 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39c4e2566e814077b635b0048c827674.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39c4e2566e814077b635b0048c827674. Aug 06 20:37:11.605284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:11.605284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:37:11.605284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:37:11.605284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:37:11.605284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:37:11.605284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:37:11.605284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:37:11.605284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:37:11.605284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:37:11.605284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:37:11.605284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:37:11.605284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application result.read() Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 06 20:37:11.606350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application yield resource Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise self.value Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application session.commit() Aug 06 20:37:11.607419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self.session.flush() Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application compat.raise_( Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 20:37:11.608376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 20:37:11.609451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 20:37:11.609451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 20:37:11.609451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 20:37:11.609451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 20:37:11.609451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 06 20:37:11.609451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 06 20:37:11.609451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 20:37:11.609451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 20:37:11.609451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 20:37:11.609451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 20:37:11.609451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 20:37:11.609451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 20:37:11.609451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 20:37:11.609451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 20:37:11.609451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application result.read() Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:37:11.610343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:37:11.612168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:37:11.612168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:37:11.612168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:37:11.612168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:37:11.612168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:37:11.612168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:37:11.612168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 06 20:37:11.612168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 06 20:37:11.612168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [parameters: {'id': '39c4e2566e814077b635b0048c827674', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 06 20:37:11.612168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 20:37:11.612168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:11.612168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:37:11.612168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:11.612168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:11.612168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:11.612959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:11.614000 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:11.614000 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 06 20:37:11.614000 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 06 20:37:11.614000 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:11.614000 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:11.614000 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 06 20:37:11.614000 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 06 20:37:11.614000 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39c4e2566e814077b635b0048c827674. Aug 06 20:37:11.614000 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:11.614608 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d16bf8-3f25-4ceb-ab62-85e86a4871eb None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:11.615154 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 399/798] 10.222.0.36 () {60 vars in 1140 bytes} [Sat Aug 6 20:37:11 2022] POST /identity/v3/projects => generated 262 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:11.728309 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d16bf8-3f25-4ceb-ab62-85e86a4871eb None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:11.776848 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5eb20-9e05-42fc-96a8-7eeae919908f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:11.777487 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5eb20-9e05-42fc-96a8-7eeae919908f None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:11.777756 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5eb20-9e05-42fc-96a8-7eeae919908f None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:11.778021 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5eb20-9e05-42fc-96a8-7eeae919908f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:11.790276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5eb20-9e05-42fc-96a8-7eeae919908f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:11.792211 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5eb20-9e05-42fc-96a8-7eeae919908f None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:11.807153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-e4f5eb20-9e05-42fc-96a8-7eeae919908f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:37:11.807153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:11.807153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:11.807153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:11.807153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:11.807153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:11.807153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:11.807153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:11.807153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:11.807153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:11.807153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:11.807153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:11.807153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:37:11.807153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:37:11.807153 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:11.808103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:11.808979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:37:11.808979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:37:11.808979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:37:11.808979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:37:11.808979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:37:11.808979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:37:11.808979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:37:11.808979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:11.808979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 400/799] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:37:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:11.816200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30758204-17b2-474a-bc04-29345a121d56 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:11.942637 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30758204-17b2-474a-bc04-29345a121d56 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:11.979257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a563570-c18e-4516-b318-37bc35aae7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:11.979864 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a563570-c18e-4516-b318-37bc35aae7bf None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:11.980142 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a563570-c18e-4516-b318-37bc35aae7bf None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:11.980405 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a563570-c18e-4516-b318-37bc35aae7bf None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:11.981068 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a563570-c18e-4516-b318-37bc35aae7bf None admin] RBAC: Adding query filter params (name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:11.981353 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a563570-c18e-4516-b318-37bc35aae7bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:11.983251 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a563570-c18e-4516-b318-37bc35aae7bf None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:12.003391 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 400/800] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Aug 6 20:37:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:13.319035 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa805abc-4a19-447e-a247-8ff060d25985 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:13.319718 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa805abc-4a19-447e-a247-8ff060d25985 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:13.319718 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa805abc-4a19-447e-a247-8ff060d25985 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:13.320936 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 401/801] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:13.326669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7b489-4374-4f09-9c53-a3c9e7d196bd None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:13.327069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7b489-4374-4f09-9c53-a3c9e7d196bd None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:13.327209 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7b489-4374-4f09-9c53-a3c9e7d196bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:13.346898 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-3fb7b489-4374-4f09-9c53-a3c9e7d196bd None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:13.348420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-3fb7b489-4374-4f09-9c53-a3c9e7d196bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:13.375818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:13.417878 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 401/802] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:13 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:37:13.441736 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa805abc-4a19-447e-a247-8ff060d25985 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:13.455079 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:13.553348 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa805abc-4a19-447e-a247-8ff060d25985 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:13.587475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a0927-da81-4844-a5eb-fe9a1ceb451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:13.588013 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a0927-da81-4844-a5eb-fe9a1ceb451a None admin] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:13.588284 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a0927-da81-4844-a5eb-fe9a1ceb451a None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:13.588548 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a0927-da81-4844-a5eb-fe9a1ceb451a None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:13.589183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a0927-da81-4844-a5eb-fe9a1ceb451a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:13.590558 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a0927-da81-4844-a5eb-fe9a1ceb451a None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:13.618623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 402/803] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Aug 6 20:37:13 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:14.294603 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853714-5715-428d-80a9-812b86d2d4d0 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:14.294908 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853714-5715-428d-80a9-812b86d2d4d0 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:14.295200 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853714-5715-428d-80a9-812b86d2d4d0 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:14.296526 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 402/804] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:14.301906 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1586eba-7130-4ab6-b093-0f526fc16a09 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:14.302184 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1586eba-7130-4ab6-b093-0f526fc16a09 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:14.302477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1586eba-7130-4ab6-b093-0f526fc16a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:14.321376 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-d1586eba-7130-4ab6-b093-0f526fc16a09 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:14.322561 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-d1586eba-7130-4ab6-b093-0f526fc16a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:14.388739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:14.402633 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 403/805] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:14 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:37:14.425192 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91853714-5715-428d-80a9-812b86d2d4d0 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:14.534669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91853714-5715-428d-80a9-812b86d2d4d0 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:14.570474 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2e0d5-836a-4819-9f64-96130f92c293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:14.571024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2e0d5-836a-4819-9f64-96130f92c293 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:14.571296 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2e0d5-836a-4819-9f64-96130f92c293 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:14.571561 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2e0d5-836a-4819-9f64-96130f92c293 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:14.572180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2e0d5-836a-4819-9f64-96130f92c293 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:14.573593 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2e0d5-836a-4819-9f64-96130f92c293 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:14.589277 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.sql.core [None req-15b2e0d5-836a-4819-9f64-96130f92c293 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 06 20:37:14.589277 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 06 20:37:14.589277 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [parameters: {'user_id': '3f47c40ad3ad46b293fe625146c48e65', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 06 20:37:14.589277 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93752) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 20:37:14.595938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-15b2e0d5-836a-4819-9f64-96130f92c293 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 06 20:37:14.595938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:14.595938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:37:14.595938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:37:14.595938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:37:14.595938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:37:14.595938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:37:14.595938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:37:14.595938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:37:14.595938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:37:14.595938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:37:14.595938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:37:14.595938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:37:14.595938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application result.read() Aug 06 20:37:14.595938 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:37:14.596795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application yield resource Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise self.value Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application session.commit() Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 20:37:14.597782 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self.session.flush() Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application compat.raise_( Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 20:37:14.598669 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:37:14.599546 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application result.read() Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:37:14.600440 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:37:14.601257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:37:14.601257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:37:14.601257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:37:14.601257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:37:14.601257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 06 20:37:14.601257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 06 20:37:14.601257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [parameters: {'user_id': '3f47c40ad3ad46b293fe625146c48e65', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 06 20:37:14.601257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 20:37:14.601257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:14.601257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:37:14.601257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:14.601257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:14.601257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:14.601257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:14.601257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 06 20:37:14.602041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 06 20:37:14.603038 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 06 20:37:14.603038 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 06 20:37:14.603038 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 20:37:14.603038 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 20:37:14.603038 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 06 20:37:14.603038 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:14.603038 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 403/806] 10.222.0.36 () {60 vars in 1131 bytes} [Sat Aug 6 20:37:14 2022] POST /identity/v3/users => generated 160 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:14.603431 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1586eba-7130-4ab6-b093-0f526fc16a09 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:14.702654 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1586eba-7130-4ab6-b093-0f526fc16a09 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:14.735909 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dc783-30e8-4ece-95c2-43ab4f003a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:14.736547 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dc783-30e8-4ece-95c2-43ab4f003a4e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:14.736815 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dc783-30e8-4ece-95c2-43ab4f003a4e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:14.737076 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dc783-30e8-4ece-95c2-43ab4f003a4e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:14.745433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0dc783-30e8-4ece-95c2-43ab4f003a4e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:14.747083 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0dc783-30e8-4ece-95c2-43ab4f003a4e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-0a0dc783-30e8-4ece-95c2-43ab4f003a4e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:37:14.759612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:14.760631 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:14.761545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:14.761545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:14.761545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:37:14.761545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:37:14.761545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:37:14.761545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:37:14.761545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:37:14.761545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:37:14.761545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:37:14.761545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:14.761545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 404/807] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:37:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:14.766903 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2e0d5-836a-4819-9f64-96130f92c293 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:14.794143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:14.871023 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2e0d5-836a-4819-9f64-96130f92c293 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:14.904095 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903d139-527a-4464-9db3-23cdcf92f72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:14.904701 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903d139-527a-4464-9db3-23cdcf92f72b None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:14.904969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903d139-527a-4464-9db3-23cdcf92f72b None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:14.905235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903d139-527a-4464-9db3-23cdcf92f72b None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:14.905924 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903d139-527a-4464-9db3-23cdcf92f72b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:14.906221 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903d139-527a-4464-9db3-23cdcf92f72b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:14.907874 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903d139-527a-4464-9db3-23cdcf92f72b None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:14.944633 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 404/808] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Aug 6 20:37:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:15.840717 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d554f-f41e-4456-8a76-7689936def6e None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:15.841315 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d554f-f41e-4456-8a76-7689936def6e None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:15.841315 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d554f-f41e-4456-8a76-7689936def6e None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:15.843261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 405/809] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:37:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:15.849329 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fa639-0783-41e3-a0d1-c6f4fa71d4f4 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:15.849814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fa639-0783-41e3-a0d1-c6f4fa71d4f4 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:15.849814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fa639-0783-41e3-a0d1-c6f4fa71d4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:15.874960 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-6d2fa639-0783-41e3-a0d1-c6f4fa71d4f4 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:15.876466 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-6d2fa639-0783-41e3-a0d1-c6f4fa71d4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:15.947920 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 405/810] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:15 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:37:15.983091 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d554f-f41e-4456-8a76-7689936def6e None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:16.054732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:16.102128 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d554f-f41e-4456-8a76-7689936def6e None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:16.137711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0d748-1ee4-4a63-87d7-3a09305b9231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:16.138332 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0d748-1ee4-4a63-87d7-3a09305b9231 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:16.138633 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0d748-1ee4-4a63-87d7-3a09305b9231 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:16.138891 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0d748-1ee4-4a63-87d7-3a09305b9231 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:16.139459 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0d748-1ee4-4a63-87d7-3a09305b9231 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:16.140842 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0d748-1ee4-4a63-87d7-3a09305b9231 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-bbc0d748-1ee4-4a63-87d7-3a09305b9231 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:16.150453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:16.151481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:16.152601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:16.152601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:16.152601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:16.152601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:16.152601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:16.152601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:16.152601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:16.152601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:16.152601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:16.152601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:16.152601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:37:16.152601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:16.152601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:37:16.152601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:37:16.152601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 406/811] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:37:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:16.160344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fa639-0783-41e3-a0d1-c6f4fa71d4f4 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:16.182887 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:16.291406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fa639-0783-41e3-a0d1-c6f4fa71d4f4 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:16.330881 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19251d99-f1e8-4cae-ac6e-2ac1e0d719fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:16.331481 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19251d99-f1e8-4cae-ac6e-2ac1e0d719fe None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:16.331774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19251d99-f1e8-4cae-ac6e-2ac1e0d719fe None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:16.332039 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19251d99-f1e8-4cae-ac6e-2ac1e0d719fe None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:16.332659 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19251d99-f1e8-4cae-ac6e-2ac1e0d719fe None admin] RBAC: Adding query filter params (name=compute) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:16.332960 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19251d99-f1e8-4cae-ac6e-2ac1e0d719fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:16.334414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19251d99-f1e8-4cae-ac6e-2ac1e0d719fe None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:16.339165 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 406/812] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Aug 6 20:37:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:16.345646 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0d748-1ee4-4a63-87d7-3a09305b9231 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:16.453688 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0d748-1ee4-4a63-87d7-3a09305b9231 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:16.474211 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:16.491578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69f931-80e8-477c-9f14-a399f3a85c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:16.492193 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69f931-80e8-477c-9f14-a399f3a85c44 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:16.492471 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69f931-80e8-477c-9f14-a399f3a85c44 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:16.492742 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69f931-80e8-477c-9f14-a399f3a85c44 None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:16.493365 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69f931-80e8-477c-9f14-a399f3a85c44 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:16.493668 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69f931-80e8-477c-9f14-a399f3a85c44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:16.495073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69f931-80e8-477c-9f14-a399f3a85c44 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:16.500050 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 407/813] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Aug 6 20:37:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:16.507449 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19251d99-f1e8-4cae-ac6e-2ac1e0d719fe None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:16.597563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:16.631721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19251d99-f1e8-4cae-ac6e-2ac1e0d719fe None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:16.666803 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad674bad-459a-41ee-9f4f-51f84a491c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:16.667435 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad674bad-459a-41ee-9f4f-51f84a491c5f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:16.667706 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad674bad-459a-41ee-9f4f-51f84a491c5f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:16.667965 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad674bad-459a-41ee-9f4f-51f84a491c5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:16.668645 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad674bad-459a-41ee-9f4f-51f84a491c5f None admin] RBAC: Adding query filter params (interface=public, service_id=4da0bed9656d405da088fc3697f9a997, region_id=RegionOne) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:16.668944 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad674bad-459a-41ee-9f4f-51f84a491c5f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:16.670295 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad674bad-459a-41ee-9f4f-51f84a491c5f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:16.677539 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 407/814] 10.222.0.36 () {56 vars in 1251 bytes} [Sat Aug 6 20:37:16 2022] GET /identity/v3/endpoints?service_id=4da0bed9656d405da088fc3697f9a997&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:16.684923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69f931-80e8-477c-9f14-a399f3a85c44 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:16.792706 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69f931-80e8-477c-9f14-a399f3a85c44 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:16.829419 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77807355-e57a-445e-8395-66b574aca9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:16.830016 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77807355-e57a-445e-8395-66b574aca9e2 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:16.830289 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77807355-e57a-445e-8395-66b574aca9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:16.830519 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77807355-e57a-445e-8395-66b574aca9e2 None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:16.831169 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77807355-e57a-445e-8395-66b574aca9e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:16.832530 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77807355-e57a-445e-8395-66b574aca9e2 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:16.839178 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 408/815] 10.222.0.36 () {56 vars in 1087 bytes} [Sat Aug 6 20:37:16 2022] GET /identity/v3/services => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:19.051762 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd49a-8089-4810-9bee-560be75ad1ee None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:19.052488 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd49a-8089-4810-9bee-560be75ad1ee None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:19.052488 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd49a-8089-4810-9bee-560be75ad1ee None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:19.054630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 408/816] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:37:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:19.060967 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dd1e6-0a3a-44a0-9350-4a441661e068 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:19.061707 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dd1e6-0a3a-44a0-9350-4a441661e068 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:19.061883 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dd1e6-0a3a-44a0-9350-4a441661e068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:19.086288 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-ec8dd1e6-0a3a-44a0-9350-4a441661e068 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:19.087507 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-ec8dd1e6-0a3a-44a0-9350-4a441661e068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:19.132129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:19.161633 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 409/817] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:19 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:37:19.185372 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcd49a-8089-4810-9bee-560be75ad1ee None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:19.299898 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcd49a-8089-4810-9bee-560be75ad1ee None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:19.342142 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be74dc7-bd5a-4062-9d65-260d6a0b06a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:19.342746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be74dc7-bd5a-4062-9d65-260d6a0b06a2 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:19.343025 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be74dc7-bd5a-4062-9d65-260d6a0b06a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:19.343288 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be74dc7-bd5a-4062-9d65-260d6a0b06a2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:19.344198 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be74dc7-bd5a-4062-9d65-260d6a0b06a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:19.345559 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be74dc7-bd5a-4062-9d65-260d6a0b06a2 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-1be74dc7-bd5a-4062-9d65-260d6a0b06a2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:19.354722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:19.355813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:19.356646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:19.356646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:19.356646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:19.356646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:19.356646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:19.356646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:19.356646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:19.356646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:19.356646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:19.356646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:19.356646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:37:19.356646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:37:19.356646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:37:19.356646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:37:19.356646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 409/818] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:37:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:19.362697 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dd1e6-0a3a-44a0-9350-4a441661e068 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:19.477818 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dd1e6-0a3a-44a0-9350-4a441661e068 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:19.512933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba7fe8-e450-4cb9-aaeb-917adde7719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:19.513538 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba7fe8-e450-4cb9-aaeb-917adde7719a None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:19.513811 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba7fe8-e450-4cb9-aaeb-917adde7719a None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:19.514078 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba7fe8-e450-4cb9-aaeb-917adde7719a None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:19.514736 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba7fe8-e450-4cb9-aaeb-917adde7719a None admin] RBAC: Adding query filter params (name=compute) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:19.515041 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba7fe8-e450-4cb9-aaeb-917adde7719a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:19.516425 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba7fe8-e450-4cb9-aaeb-917adde7719a None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:19.521118 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 410/819] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Aug 6 20:37:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:19.527795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be74dc7-bd5a-4062-9d65-260d6a0b06a2 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:19.532255 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:19.629969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be74dc7-bd5a-4062-9d65-260d6a0b06a2 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:19.668436 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93677663-9dfb-4740-9d4f-2a02f1b21817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:19.669021 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93677663-9dfb-4740-9d4f-2a02f1b21817 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:19.669288 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93677663-9dfb-4740-9d4f-2a02f1b21817 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:19.669549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93677663-9dfb-4740-9d4f-2a02f1b21817 None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:19.670159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93677663-9dfb-4740-9d4f-2a02f1b21817 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:19.670448 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93677663-9dfb-4740-9d4f-2a02f1b21817 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:19.671837 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93677663-9dfb-4740-9d4f-2a02f1b21817 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:19.676664 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 410/820] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Aug 6 20:37:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:19.683065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba7fe8-e450-4cb9-aaeb-917adde7719a None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:19.727477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:19.785792 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba7fe8-e450-4cb9-aaeb-917adde7719a None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:19.822620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e04b46-d526-4c7d-9003-d3ccfaa6d3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:19.823238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e04b46-d526-4c7d-9003-d3ccfaa6d3e4 None admin] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:19.823508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e04b46-d526-4c7d-9003-d3ccfaa6d3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:19.823768 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e04b46-d526-4c7d-9003-d3ccfaa6d3e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:19.824454 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e04b46-d526-4c7d-9003-d3ccfaa6d3e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:19.825830 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e04b46-d526-4c7d-9003-d3ccfaa6d3e4 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:19.856038 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 411/821] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:37:29.674523 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=66 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:29.848770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=50,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:21.544899 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112937e1-8327-46db-af41-13f536ebb3cc None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.545541 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112937e1-8327-46db-af41-13f536ebb3cc None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.545541 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112937e1-8327-46db-af41-13f536ebb3cc None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.547055 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 411/822] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:21.552845 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e37ce-9aec-4f80-9bd7-667f979b66dd None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.553405 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e37ce-9aec-4f80-9bd7-667f979b66dd None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.553405 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e37ce-9aec-4f80-9bd7-667f979b66dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.576216 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-476e37ce-9aec-4f80-9bd7-667f979b66dd None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:21.577410 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-476e37ce-9aec-4f80-9bd7-667f979b66dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:21.678469 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 412/823] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:21 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:38:21.704816 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112937e1-8327-46db-af41-13f536ebb3cc None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:21.822028 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112937e1-8327-46db-af41-13f536ebb3cc None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:21.862941 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398fc39-f130-481f-aea3-06ae0889ad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:21.863662 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398fc39-f130-481f-aea3-06ae0889ad8e None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.863931 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398fc39-f130-481f-aea3-06ae0889ad8e None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.864248 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398fc39-f130-481f-aea3-06ae0889ad8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.875885 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398fc39-f130-481f-aea3-06ae0889ad8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:21.877520 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398fc39-f130-481f-aea3-06ae0889ad8e None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-8398fc39-f130-481f-aea3-06ae0889ad8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:21.894241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:21.895854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:21.897474 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:21.897474 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:21.897474 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:21.897474 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 412/824] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:21.902525 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e37ce-9aec-4f80-9bd7-667f979b66dd None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:22.019897 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e37ce-9aec-4f80-9bd7-667f979b66dd None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:22.049733 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:22.061716 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd5523-84f7-4966-9f44-b59503286323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:22.062277 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd5523-84f7-4966-9f44-b59503286323 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.062567 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd5523-84f7-4966-9f44-b59503286323 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.062852 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd5523-84f7-4966-9f44-b59503286323 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.063458 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd5523-84f7-4966-9f44-b59503286323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:22.063748 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd5523-84f7-4966-9f44-b59503286323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:22.065129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd5523-84f7-4966-9f44-b59503286323 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:22.077619 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 413/825] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:22.084243 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398fc39-f130-481f-aea3-06ae0889ad8e None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:22.162766 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:22.216702 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398fc39-f130-481f-aea3-06ae0889ad8e None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:22.262569 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf68508-ae23-456c-ba1e-1f1e9f70a6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:22.263318 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf68508-ae23-456c-ba1e-1f1e9f70a6d1 None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.263745 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf68508-ae23-456c-ba1e-1f1e9f70a6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.264048 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf68508-ae23-456c-ba1e-1f1e9f70a6d1 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.264779 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf68508-ae23-456c-ba1e-1f1e9f70a6d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:22.267066 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf68508-ae23-456c-ba1e-1f1e9f70a6d1 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:22.292288 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 413/826] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Aug 6 20:38:22 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:24.704495 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8600e2-2bc1-4c9b-b18d-2cfe7eaa7d0c None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:24.705065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8600e2-2bc1-4c9b-b18d-2cfe7eaa7d0c None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:24.705169 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8600e2-2bc1-4c9b-b18d-2cfe7eaa7d0c None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:24.706479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 414/827] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:24.712364 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893c6b2-ae32-416a-8dd7-99c25208e1ab None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:24.712817 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893c6b2-ae32-416a-8dd7-99c25208e1ab None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:24.712923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893c6b2-ae32-416a-8dd7-99c25208e1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:24.735774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-f893c6b2-ae32-416a-8dd7-99c25208e1ab None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:24.737339 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-f893c6b2-ae32-416a-8dd7-99c25208e1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:24.810241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 414/828] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:24 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:38:24.835362 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8600e2-2bc1-4c9b-b18d-2cfe7eaa7d0c None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:24.950172 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8600e2-2bc1-4c9b-b18d-2cfe7eaa7d0c None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:24.990127 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798ed49-6c8c-4b34-86ea-6aa2a311fd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:24.990810 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798ed49-6c8c-4b34-86ea-6aa2a311fd2d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:24.991122 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798ed49-6c8c-4b34-86ea-6aa2a311fd2d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:24.991414 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798ed49-6c8c-4b34-86ea-6aa2a311fd2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.002017 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798ed49-6c8c-4b34-86ea-6aa2a311fd2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-3798ed49-6c8c-4b34-86ea-6aa2a311fd2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:25.007611 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:25.010353 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:25.011463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:25.011463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:25.011463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:25.011463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:25.011463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:25.011463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:25.011463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:25.011463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:25.011463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:25.011463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:25.011463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:25.011463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:25.011463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 415/829] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:25.015230 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893c6b2-ae32-416a-8dd7-99c25208e1ab None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:25.067131 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:25.136598 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893c6b2-ae32-416a-8dd7-99c25208e1ab None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:25.170324 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690f029-774a-4fa2-8e08-95ed74c633eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:25.171277 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690f029-774a-4fa2-8e08-95ed74c633eb None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.171277 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690f029-774a-4fa2-8e08-95ed74c633eb None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.171504 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690f029-774a-4fa2-8e08-95ed74c633eb None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.172158 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690f029-774a-4fa2-8e08-95ed74c633eb None admin] RBAC: Adding query filter params (name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:25.172460 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690f029-774a-4fa2-8e08-95ed74c633eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:25.173826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690f029-774a-4fa2-8e08-95ed74c633eb None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:25.182967 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 415/830] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Aug 6 20:38:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:25.189019 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798ed49-6c8c-4b34-86ea-6aa2a311fd2d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:25.238648 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:25.293390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798ed49-6c8c-4b34-86ea-6aa2a311fd2d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:25.337795 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad43fbd-4eeb-4daa-a50c-48cb191f64f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:25.338426 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad43fbd-4eeb-4daa-a50c-48cb191f64f1 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.338716 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad43fbd-4eeb-4daa-a50c-48cb191f64f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.338981 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad43fbd-4eeb-4daa-a50c-48cb191f64f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.350428 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad43fbd-4eeb-4daa-a50c-48cb191f64f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:25.352268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad43fbd-4eeb-4daa-a50c-48cb191f64f1 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-bad43fbd-4eeb-4daa-a50c-48cb191f64f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:25.371492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:25.372472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:25.378261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:25.378261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:25.378261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:25.378261 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 416/831] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:25.378881 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690f029-774a-4fa2-8e08-95ed74c633eb None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:25.489348 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:25.492591 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690f029-774a-4fa2-8e08-95ed74c633eb None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:25.531035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3553766-fb61-4c02-a75f-a57e5b4c52bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:25.531650 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3553766-fb61-4c02-a75f-a57e5b4c52bd None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.531943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3553766-fb61-4c02-a75f-a57e5b4c52bd None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.532192 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3553766-fb61-4c02-a75f-a57e5b4c52bd None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.532832 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3553766-fb61-4c02-a75f-a57e5b4c52bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:25.533148 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3553766-fb61-4c02-a75f-a57e5b4c52bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:25.534506 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3553766-fb61-4c02-a75f-a57e5b4c52bd None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:25.547870 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 416/832] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:25.553762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad43fbd-4eeb-4daa-a50c-48cb191f64f1 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:25.665271 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:25.669872 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad43fbd-4eeb-4daa-a50c-48cb191f64f1 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:25.708859 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190e42d-b014-434d-be9b-1425ed23d61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:25.709554 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190e42d-b014-434d-be9b-1425ed23d61e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.709760 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190e42d-b014-434d-be9b-1425ed23d61e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.710030 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190e42d-b014-434d-be9b-1425ed23d61e None admin] PATH_INFO: `/v3/users/placement` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.718215 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190e42d-b014-434d-be9b-1425ed23d61e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:25.720293 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190e42d-b014-434d-be9b-1425ed23d61e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-0190e42d-b014-434d-be9b-1425ed23d61e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:25.734190 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:25.735392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:25.736347 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:25.736347 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:25.736347 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:25.736347 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:25.736347 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:25.736347 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:25.736347 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:25.736347 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:25.736347 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:38:25.736347 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:25.736347 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 417/833] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:25.743253 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3553766-fb61-4c02-a75f-a57e5b4c52bd None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:25.856907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3553766-fb61-4c02-a75f-a57e5b4c52bd None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:25.898233 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59415076-a6a2-451e-9b98-c79614cab177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:25.898865 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59415076-a6a2-451e-9b98-c79614cab177 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.899135 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59415076-a6a2-451e-9b98-c79614cab177 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.899402 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59415076-a6a2-451e-9b98-c79614cab177 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.900145 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59415076-a6a2-451e-9b98-c79614cab177 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:25.900432 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59415076-a6a2-451e-9b98-c79614cab177 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:25.901988 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59415076-a6a2-451e-9b98-c79614cab177 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:25.919959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 417/834] 10.222.0.36 () {56 vars in 1143 bytes} [Sat Aug 6 20:38:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:25.926244 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190e42d-b014-434d-be9b-1425ed23d61e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:26.045040 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190e42d-b014-434d-be9b-1425ed23d61e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:26.093945 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545b5e7-8e95-4982-9d61-106de080a284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:26.095054 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b5e7-8e95-4982-9d61-106de080a284 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:26.095456 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b5e7-8e95-4982-9d61-106de080a284 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:26.095726 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b5e7-8e95-4982-9d61-106de080a284 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:26.134624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:26.183365 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545b5e7-8e95-4982-9d61-106de080a284 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:26.184837 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545b5e7-8e95-4982-9d61-106de080a284 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:26.297021 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 418/835] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:25 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:38:26.303143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59415076-a6a2-451e-9b98-c79614cab177 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:26.323528 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:26.411055 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59415076-a6a2-451e-9b98-c79614cab177 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:26.449885 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b5258-7d59-4038-afb9-92844a385ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:26.450992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b5258-7d59-4038-afb9-92844a385ace None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:26.451403 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b5258-7d59-4038-afb9-92844a385ace None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:26.451789 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b5258-7d59-4038-afb9-92844a385ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:26.465893 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b5258-7d59-4038-afb9-92844a385ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:26.467964 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b5258-7d59-4038-afb9-92844a385ace None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-9e8b5258-7d59-4038-afb9-92844a385ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:26.487567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:26.488678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:26.489696 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:26.489696 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:26.489696 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:26.489898 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 418/836] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:26.497341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545b5e7-8e95-4982-9d61-106de080a284 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:26.558449 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:26.601865 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545b5e7-8e95-4982-9d61-106de080a284 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:26.639096 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4b48a-040e-4b7e-bcdb-f7645a42c644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:26.639707 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4b48a-040e-4b7e-bcdb-f7645a42c644 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:26.639977 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4b48a-040e-4b7e-bcdb-f7645a42c644 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:26.640252 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4b48a-040e-4b7e-bcdb-f7645a42c644 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:26.640999 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4b48a-040e-4b7e-bcdb-f7645a42c644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:26.641301 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4b48a-040e-4b7e-bcdb-f7645a42c644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:26.642817 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4b48a-040e-4b7e-bcdb-f7645a42c644 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:26.656570 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 419/837] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:26.662525 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b5258-7d59-4038-afb9-92844a385ace None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:26.739202 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:26.799071 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b5258-7d59-4038-afb9-92844a385ace None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:26.842852 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de29ce-ad76-46db-96c9-bff912067548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:26.843492 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de29ce-ad76-46db-96c9-bff912067548 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:26.843763 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de29ce-ad76-46db-96c9-bff912067548 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:26.844028 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de29ce-ad76-46db-96c9-bff912067548 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:26.853096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de29ce-ad76-46db-96c9-bff912067548 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:26.854610 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de29ce-ad76-46db-96c9-bff912067548 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:26.866738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-a5de29ce-ad76-46db-96c9-bff912067548 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:26.866738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:26.866738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:26.866738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:26.866738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:26.866738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:26.866738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:26.866738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:26.866738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:26.866738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:26.866738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:26.866738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:26.866738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:26.866738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:26.866738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:26.867859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:26.868903 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:26.868903 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:26.868903 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:26.868903 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:26.868903 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:26.868903 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:26.868903 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:26.868903 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:26.870616 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 419/838] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:26.878101 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4b48a-040e-4b7e-bcdb-f7645a42c644 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:26.987040 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4b48a-040e-4b7e-bcdb-f7645a42c644 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:27.004094 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:27.021772 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fd14e-3a6c-4cec-ae15-2ed09e603707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:27.022828 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fd14e-3a6c-4cec-ae15-2ed09e603707 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:27.023145 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fd14e-3a6c-4cec-ae15-2ed09e603707 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:27.023575 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fd14e-3a6c-4cec-ae15-2ed09e603707 None admin] PATH_INFO: `/v3/projects` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:27.024498 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fd14e-3a6c-4cec-ae15-2ed09e603707 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:27.024849 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fd14e-3a6c-4cec-ae15-2ed09e603707 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:27.027084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fd14e-3a6c-4cec-ae15-2ed09e603707 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:27.042367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 420/839] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:27.049190 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de29ce-ad76-46db-96c9-bff912067548 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:27.160300 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de29ce-ad76-46db-96c9-bff912067548 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:27.188127 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:27.194269 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83826743-eeaa-49f7-8f73-d5a62548df98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:27.194907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83826743-eeaa-49f7-8f73-d5a62548df98 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:27.195186 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83826743-eeaa-49f7-8f73-d5a62548df98 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:27.195456 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83826743-eeaa-49f7-8f73-d5a62548df98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:27.196176 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83826743-eeaa-49f7-8f73-d5a62548df98 None admin] RBAC: Adding query filter params (role.id=71540591f26d431ba1b1ccb3615c72ea, scope.project.id=ce157732829848e59f95d0cd15a897eb, user.id=47953125a0e64fef8f36c17b3504e9e6) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:27.196481 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83826743-eeaa-49f7-8f73-d5a62548df98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:27.197911 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83826743-eeaa-49f7-8f73-d5a62548df98 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:27.203218 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 420/840] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:27 2022] GET /identity/v3/role_assignments?user.id=47953125a0e64fef8f36c17b3504e9e6&scope.project.id=ce157732829848e59f95d0cd15a897eb&role.id=71540591f26d431ba1b1ccb3615c72ea => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:29.413135 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8d8da-5575-4814-a844-2aaf2a939327 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:29.413720 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8d8da-5575-4814-a844-2aaf2a939327 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:29.413720 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8d8da-5575-4814-a844-2aaf2a939327 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:29.415234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 421/841] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:29.420582 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2c925-34e0-44f8-bc6c-9c2b26fa3119 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:29.421128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2c925-34e0-44f8-bc6c-9c2b26fa3119 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:29.421128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2c925-34e0-44f8-bc6c-9c2b26fa3119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:29.440558 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-91a2c925-34e0-44f8-bc6c-9c2b26fa3119 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:29.442090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-91a2c925-34e0-44f8-bc6c-9c2b26fa3119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:29.522623 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 421/842] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:29 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:38:29.546798 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8d8da-5575-4814-a844-2aaf2a939327 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:29.662609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8d8da-5575-4814-a844-2aaf2a939327 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:29.697300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdff909-98f0-4f09-b431-06c06766b237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:29.697855 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdff909-98f0-4f09-b431-06c06766b237 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:29.698126 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdff909-98f0-4f09-b431-06c06766b237 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:29.698391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdff909-98f0-4f09-b431-06c06766b237 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:29.710319 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdff909-98f0-4f09-b431-06c06766b237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-efdff909-98f0-4f09-b431-06c06766b237 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:29.715105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:29.716108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:29.717073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:29.717073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:29.717073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:29.717073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:29.717073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:29.717073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:29.717073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:29.717073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:29.717073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:29.717073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:29.717073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:29.717073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:29.717073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 422/843] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:29.724780 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2c925-34e0-44f8-bc6c-9c2b26fa3119 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:29.845967 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2c925-34e0-44f8-bc6c-9c2b26fa3119 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:29.876694 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:29.888105 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc8345-abcd-49b4-bae4-09b1d13cc1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:29.888721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc8345-abcd-49b4-bae4-09b1d13cc1a6 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:29.888995 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc8345-abcd-49b4-bae4-09b1d13cc1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:29.889262 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc8345-abcd-49b4-bae4-09b1d13cc1a6 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:29.889919 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc8345-abcd-49b4-bae4-09b1d13cc1a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:29.890217 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc8345-abcd-49b4-bae4-09b1d13cc1a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:29.891620 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc8345-abcd-49b4-bae4-09b1d13cc1a6 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:29.900066 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 422/844] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Aug 6 20:38:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:29.905940 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdff909-98f0-4f09-b431-06c06766b237 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:29.951410 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:30.037892 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdff909-98f0-4f09-b431-06c06766b237 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:30.080696 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d68cf-4290-4a8e-95f8-ec3e91acdbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:30.081674 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d68cf-4290-4a8e-95f8-ec3e91acdbc6 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:30.081946 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d68cf-4290-4a8e-95f8-ec3e91acdbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:30.082208 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d68cf-4290-4a8e-95f8-ec3e91acdbc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:30.093595 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d68cf-4290-4a8e-95f8-ec3e91acdbc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:30.095474 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d68cf-4290-4a8e-95f8-ec3e91acdbc6 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-668d68cf-4290-4a8e-95f8-ec3e91acdbc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:30.110673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:30.111763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:30.117732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:30.117732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:30.117732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:30.117732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 423/845] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:30.118823 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc8345-abcd-49b4-bae4-09b1d13cc1a6 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:30.218985 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc8345-abcd-49b4-bae4-09b1d13cc1a6 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:30.260636 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee07f2-a339-46da-b3cf-3ed1b5c41045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:30.261435 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee07f2-a339-46da-b3cf-3ed1b5c41045 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:30.261736 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee07f2-a339-46da-b3cf-3ed1b5c41045 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:30.262036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee07f2-a339-46da-b3cf-3ed1b5c41045 None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:30.262749 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee07f2-a339-46da-b3cf-3ed1b5c41045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:30.263058 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee07f2-a339-46da-b3cf-3ed1b5c41045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:30.264560 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee07f2-a339-46da-b3cf-3ed1b5c41045 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:30.277348 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 423/846] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:30.283385 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d68cf-4290-4a8e-95f8-ec3e91acdbc6 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:30.382081 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:30.393143 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d68cf-4290-4a8e-95f8-ec3e91acdbc6 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:30.428612 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854f875-aa4a-4808-84ae-2758bd2ad750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:30.429321 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854f875-aa4a-4808-84ae-2758bd2ad750 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:30.429495 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854f875-aa4a-4808-84ae-2758bd2ad750 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:30.429756 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854f875-aa4a-4808-84ae-2758bd2ad750 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:30.447760 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854f875-aa4a-4808-84ae-2758bd2ad750 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:30.449217 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854f875-aa4a-4808-84ae-2758bd2ad750 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-0854f875-aa4a-4808-84ae-2758bd2ad750 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:30.462004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:30.463196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:30.464520 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:30.464520 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:30.464520 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:30.464520 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:30.464520 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:30.464520 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:30.464520 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:30.464520 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:30.464520 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:38:30.464520 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:30.464520 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 424/847] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:30.472485 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee07f2-a339-46da-b3cf-3ed1b5c41045 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:30.526697 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:30.586000 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee07f2-a339-46da-b3cf-3ed1b5c41045 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:30.624367 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba503e-b95f-4a85-9ba1-266cce480d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:30.624989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba503e-b95f-4a85-9ba1-266cce480d37 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:30.625262 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba503e-b95f-4a85-9ba1-266cce480d37 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:30.625578 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba503e-b95f-4a85-9ba1-266cce480d37 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:30.626312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba503e-b95f-4a85-9ba1-266cce480d37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:30.626731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba503e-b95f-4a85-9ba1-266cce480d37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:30.628174 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba503e-b95f-4a85-9ba1-266cce480d37 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:30.645501 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 424/848] 10.222.0.36 () {56 vars in 1143 bytes} [Sat Aug 6 20:38:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:30.651709 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854f875-aa4a-4808-84ae-2758bd2ad750 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:30.762429 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854f875-aa4a-4808-84ae-2758bd2ad750 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:30.799383 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd717ba-3824-455d-bd32-daa45815c605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:30.800084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd717ba-3824-455d-bd32-daa45815c605 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:30.800428 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd717ba-3824-455d-bd32-daa45815c605 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:30.800705 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd717ba-3824-455d-bd32-daa45815c605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:30.812226 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd717ba-3824-455d-bd32-daa45815c605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:30.813690 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd717ba-3824-455d-bd32-daa45815c605 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-2dd717ba-3824-455d-bd32-daa45815c605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:30.829182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:30.830412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:30.831323 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:30.831323 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:30.831323 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:30.831323 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 425/849] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:30.837468 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba503e-b95f-4a85-9ba1-266cce480d37 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:30.947336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba503e-b95f-4a85-9ba1-266cce480d37 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:30.950090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:30.987868 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8dca6-d139-4d00-ad17-bd85680eaecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:30.988475 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8dca6-d139-4d00-ad17-bd85680eaecb None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:30.988746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8dca6-d139-4d00-ad17-bd85680eaecb None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:30.989010 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8dca6-d139-4d00-ad17-bd85680eaecb None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:30.989895 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8dca6-d139-4d00-ad17-bd85680eaecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:30.990250 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8dca6-d139-4d00-ad17-bd85680eaecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:30.991655 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8dca6-d139-4d00-ad17-bd85680eaecb None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:31.003063 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 425/850] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:31.010023 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd717ba-3824-455d-bd32-daa45815c605 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:31.014395 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:31.133366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd717ba-3824-455d-bd32-daa45815c605 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:31.174219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedd216-cfbf-461c-a141-26de0e222fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:31.174927 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedd216-cfbf-461c-a141-26de0e222fb8 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:31.175203 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedd216-cfbf-461c-a141-26de0e222fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:31.175504 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedd216-cfbf-461c-a141-26de0e222fb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:31.184000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedd216-cfbf-461c-a141-26de0e222fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:31.185167 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedd216-cfbf-461c-a141-26de0e222fb8 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:31.198221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-8dedd216-cfbf-461c-a141-26de0e222fb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:31.198221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:31.198221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:31.198221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:31.198221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:31.198221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:31.198221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:31.198221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:31.198221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:31.198221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:31.198221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:31.198221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:31.198221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:31.198221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:31.198221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:31.199276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:31.200251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:31.200251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:31.200251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:31.200251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:31.200251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:31.200251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:31.200251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:31.200251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:31.200251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 426/851] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:31.208121 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8dca6-d139-4d00-ad17-bd85680eaecb None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:31.323476 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8dca6-d139-4d00-ad17-bd85680eaecb None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:31.360824 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444967d-26bd-452e-879e-4cdc85566025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:31.361442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444967d-26bd-452e-879e-4cdc85566025 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:31.361718 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444967d-26bd-452e-879e-4cdc85566025 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:31.361986 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444967d-26bd-452e-879e-4cdc85566025 None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:31.362712 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444967d-26bd-452e-879e-4cdc85566025 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:31.363016 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444967d-26bd-452e-879e-4cdc85566025 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:31.364483 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444967d-26bd-452e-879e-4cdc85566025 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:31.379441 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 426/852] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:31.385867 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedd216-cfbf-461c-a141-26de0e222fb8 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:31.456511 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:31.498297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedd216-cfbf-461c-a141-26de0e222fb8 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:31.548761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4701f0-a62b-4eb3-9c33-8d0527d99bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:31.549565 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4701f0-a62b-4eb3-9c33-8d0527d99bda None admin] REQUEST_METHOD: `PUT` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:31.549897 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4701f0-a62b-4eb3-9c33-8d0527d99bda None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:31.550120 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4701f0-a62b-4eb3-9c33-8d0527d99bda None admin] PATH_INFO: `/v3/projects/ce157732829848e59f95d0cd15a897eb/users/47953125a0e64fef8f36c17b3504e9e6/roles/71540591f26d431ba1b1ccb3615c72ea` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:31.569605 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4701f0-a62b-4eb3-9c33-8d0527d99bda None admin] RBAC: Authorizing `identity:create_grant(project_id=ce157732829848e59f95d0cd15a897eb, user_id=47953125a0e64fef8f36c17b3504e9e6, role_id=71540591f26d431ba1b1ccb3615c72ea)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:31.571116 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4701f0-a62b-4eb3-9c33-8d0527d99bda None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:31.588626 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 427/853] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:38:31 2022] PUT /identity/v3/projects/ce157732829848e59f95d0cd15a897eb/users/47953125a0e64fef8f36c17b3504e9e6/roles/71540591f26d431ba1b1ccb3615c72ea => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:34.009963 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786fa3a-093e-4037-8575-2068cb4d7c68 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:34.010554 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786fa3a-093e-4037-8575-2068cb4d7c68 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:34.010554 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786fa3a-093e-4037-8575-2068cb4d7c68 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:34.013052 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 427/854] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:38:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:34.018932 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99eb2-9fd1-456e-82e5-125a7964b8c9 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:34.019374 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99eb2-9fd1-456e-82e5-125a7964b8c9 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:34.019479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99eb2-9fd1-456e-82e5-125a7964b8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:34.039867 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-42a99eb2-9fd1-456e-82e5-125a7964b8c9 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:34.041071 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-42a99eb2-9fd1-456e-82e5-125a7964b8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:34.116306 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 428/855] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:34 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:38:34.141217 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786fa3a-093e-4037-8575-2068cb4d7c68 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:34.169035 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:34.250046 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786fa3a-093e-4037-8575-2068cb4d7c68 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:34.290328 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3babbe-b07c-45dc-bb2c-2f6443727b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:34.290904 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3babbe-b07c-45dc-bb2c-2f6443727b68 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:34.291176 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3babbe-b07c-45dc-bb2c-2f6443727b68 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:34.291441 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3babbe-b07c-45dc-bb2c-2f6443727b68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:34.301694 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3babbe-b07c-45dc-bb2c-2f6443727b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-4d3babbe-b07c-45dc-bb2c-2f6443727b68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:34.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:34.307687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:34.308750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:34.308750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:34.308750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:34.308750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:34.308750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:34.308750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:34.308750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:34.308750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:34.308750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:34.308750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:34.308750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:34.308750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:34.308750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 428/856] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:34.314058 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a99eb2-9fd1-456e-82e5-125a7964b8c9 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:34.358853 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:34.421119 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a99eb2-9fd1-456e-82e5-125a7964b8c9 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:34.457406 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c43ed-515e-4e9b-ab9b-48ca8fb71820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:34.458009 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c43ed-515e-4e9b-ab9b-48ca8fb71820 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:34.458370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c43ed-515e-4e9b-ab9b-48ca8fb71820 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:34.459071 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c43ed-515e-4e9b-ab9b-48ca8fb71820 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:34.459741 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c43ed-515e-4e9b-ab9b-48ca8fb71820 None admin] RBAC: Adding query filter params (name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:34.460035 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c43ed-515e-4e9b-ab9b-48ca8fb71820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:34.461408 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c43ed-515e-4e9b-ab9b-48ca8fb71820 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:34.470533 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 429/857] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Aug 6 20:38:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:34.476441 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3babbe-b07c-45dc-bb2c-2f6443727b68 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:34.571763 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:34.588247 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3babbe-b07c-45dc-bb2c-2f6443727b68 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:34.628502 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ee243-d97c-4d56-944e-7fa190936498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:34.629238 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ee243-d97c-4d56-944e-7fa190936498 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:34.629516 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ee243-d97c-4d56-944e-7fa190936498 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:34.629818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ee243-d97c-4d56-944e-7fa190936498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:34.641753 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ee243-d97c-4d56-944e-7fa190936498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:34.643433 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ee243-d97c-4d56-944e-7fa190936498 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-856ee243-d97c-4d56-944e-7fa190936498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:34.659651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:34.660731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:34.661834 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:34.661834 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:34.661834 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:34.661834 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 429/858] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:34.667892 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c43ed-515e-4e9b-ab9b-48ca8fb71820 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:34.783366 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c43ed-515e-4e9b-ab9b-48ca8fb71820 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:34.785992 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:34.819251 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e335b98-707f-4ba9-914c-0bb7e061ee07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:34.819860 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e335b98-707f-4ba9-914c-0bb7e061ee07 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:34.820136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e335b98-707f-4ba9-914c-0bb7e061ee07 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:34.820406 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e335b98-707f-4ba9-914c-0bb7e061ee07 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:34.821038 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e335b98-707f-4ba9-914c-0bb7e061ee07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:34.821339 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e335b98-707f-4ba9-914c-0bb7e061ee07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:34.822793 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e335b98-707f-4ba9-914c-0bb7e061ee07 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:34.834179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 430/859] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:34.840155 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ee243-d97c-4d56-944e-7fa190936498 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:34.945288 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ee243-d97c-4d56-944e-7fa190936498 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:34.984336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a88b-46f9-4da8-ad53-856fd591f9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:34.985140 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a88b-46f9-4da8-ad53-856fd591f9fd None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:34.985484 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a88b-46f9-4da8-ad53-856fd591f9fd None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:34.985822 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a88b-46f9-4da8-ad53-856fd591f9fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:34.989088 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:34.995761 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383a88b-46f9-4da8-ad53-856fd591f9fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:34.997609 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383a88b-46f9-4da8-ad53-856fd591f9fd None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-7383a88b-46f9-4da8-ad53-856fd591f9fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:35.012540 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:35.014004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:35.014948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:35.014948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:35.014948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:35.014948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:35.014948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:35.014948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:35.014948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:35.014948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:35.014948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:38:35.014948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:35.014948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 430/860] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:35.020416 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e335b98-707f-4ba9-914c-0bb7e061ee07 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:35.141400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e335b98-707f-4ba9-914c-0bb7e061ee07 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:35.182649 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd06857-803c-4be7-8032-d8af60093bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:35.183263 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd06857-803c-4be7-8032-d8af60093bc6 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:35.183531 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd06857-803c-4be7-8032-d8af60093bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:35.183796 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd06857-803c-4be7-8032-d8af60093bc6 None admin] PATH_INFO: `/v3/users` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:35.184515 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd06857-803c-4be7-8032-d8af60093bc6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:35.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd06857-803c-4be7-8032-d8af60093bc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:35.186240 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd06857-803c-4be7-8032-d8af60093bc6 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:35.211154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 431/861] 10.222.0.36 () {56 vars in 1143 bytes} [Sat Aug 6 20:38:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:35.212794 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a88b-46f9-4da8-ad53-856fd591f9fd None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:35.325270 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a88b-46f9-4da8-ad53-856fd591f9fd None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:35.362052 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059672e9-ee05-4964-9583-d7302f90de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:35.362838 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059672e9-ee05-4964-9583-d7302f90de61 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:35.363116 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059672e9-ee05-4964-9583-d7302f90de61 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:35.363457 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059672e9-ee05-4964-9583-d7302f90de61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:35.430512 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:35.437515 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059672e9-ee05-4964-9583-d7302f90de61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:35.439006 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059672e9-ee05-4964-9583-d7302f90de61 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:35.548330 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 431/862] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:35 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:38:35.554805 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd06857-803c-4be7-8032-d8af60093bc6 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:35.581127 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:35.660163 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd06857-803c-4be7-8032-d8af60093bc6 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:35.696513 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8bde6-5dbb-407d-9932-a653477b7c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:35.697088 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8bde6-5dbb-407d-9932-a653477b7c38 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:35.697361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8bde6-5dbb-407d-9932-a653477b7c38 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:35.697711 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8bde6-5dbb-407d-9932-a653477b7c38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:35.708437 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8bde6-5dbb-407d-9932-a653477b7c38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:35.709904 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8bde6-5dbb-407d-9932-a653477b7c38 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-3cb8bde6-5dbb-407d-9932-a653477b7c38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:35.725489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:35.726780 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:35.727922 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:35.727922 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:35.727922 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:35.727922 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 432/863] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:35.734318 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059672e9-ee05-4964-9583-d7302f90de61 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:35.836330 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:35.843351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059672e9-ee05-4964-9583-d7302f90de61 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:35.880762 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226a7b8-ff2d-4a5d-82ac-a087f8b35ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:35.881409 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226a7b8-ff2d-4a5d-82ac-a087f8b35ca1 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:35.881686 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226a7b8-ff2d-4a5d-82ac-a087f8b35ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:35.882003 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226a7b8-ff2d-4a5d-82ac-a087f8b35ca1 None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:35.882614 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226a7b8-ff2d-4a5d-82ac-a087f8b35ca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:35.882927 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226a7b8-ff2d-4a5d-82ac-a087f8b35ca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:35.884326 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226a7b8-ff2d-4a5d-82ac-a087f8b35ca1 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:35.901102 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 432/864] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:35.903840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8bde6-5dbb-407d-9932-a653477b7c38 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:35.999896 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:36.031988 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8bde6-5dbb-407d-9932-a653477b7c38 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:36.074273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19961c3b-a610-4e4a-9b8b-e71feea582a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:36.075349 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19961c3b-a610-4e4a-9b8b-e71feea582a1 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:36.075697 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19961c3b-a610-4e4a-9b8b-e71feea582a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:36.076034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19961c3b-a610-4e4a-9b8b-e71feea582a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:36.084476 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19961c3b-a610-4e4a-9b8b-e71feea582a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:36.086052 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19961c3b-a610-4e4a-9b8b-e71feea582a1 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:36.100207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-19961c3b-a610-4e4a-9b8b-e71feea582a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:36.100207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:36.100207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:36.100207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:36.100207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:36.100207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:36.100207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:36.100207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:36.100207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:36.100207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:36.100207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:36.100207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:36.100207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:36.100207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:36.100207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:36.101360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:36.107505 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:36.107505 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:36.107505 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:36.107505 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:36.107505 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:36.107505 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:36.107505 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:36.107505 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:36.107505 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 433/865] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:36.107989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226a7b8-ff2d-4a5d-82ac-a087f8b35ca1 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:36.232367 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226a7b8-ff2d-4a5d-82ac-a087f8b35ca1 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:36.271291 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1904fd-f12d-4687-8dcf-1b6ff32dd05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:36.271828 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1904fd-f12d-4687-8dcf-1b6ff32dd05f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:36.272102 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1904fd-f12d-4687-8dcf-1b6ff32dd05f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:36.272370 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1904fd-f12d-4687-8dcf-1b6ff32dd05f None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:36.273062 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1904fd-f12d-4687-8dcf-1b6ff32dd05f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:36.273355 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1904fd-f12d-4687-8dcf-1b6ff32dd05f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:36.274853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1904fd-f12d-4687-8dcf-1b6ff32dd05f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:36.288411 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 433/866] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:36.294697 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19961c3b-a610-4e4a-9b8b-e71feea582a1 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:36.406540 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19961c3b-a610-4e4a-9b8b-e71feea582a1 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:36.440845 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a842c-1c0c-4de1-8488-a7bd2aa3a3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:36.441513 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a842c-1c0c-4de1-8488-a7bd2aa3a3cc None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:36.441809 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a842c-1c0c-4de1-8488-a7bd2aa3a3cc None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:36.442147 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a842c-1c0c-4de1-8488-a7bd2aa3a3cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:36.443037 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a842c-1c0c-4de1-8488-a7bd2aa3a3cc None admin] RBAC: Adding query filter params (role.id=71540591f26d431ba1b1ccb3615c72ea, scope.project.id=ce157732829848e59f95d0cd15a897eb, user.id=47953125a0e64fef8f36c17b3504e9e6) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:36.443344 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a842c-1c0c-4de1-8488-a7bd2aa3a3cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:36.445085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a842c-1c0c-4de1-8488-a7bd2aa3a3cc None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:36.447077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:36.452719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 434/867] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:36 2022] GET /identity/v3/role_assignments?user.id=47953125a0e64fef8f36c17b3504e9e6&scope.project.id=ce157732829848e59f95d0cd15a897eb&role.id=71540591f26d431ba1b1ccb3615c72ea => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:38.785826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6449d9-44fd-4351-9b76-ce18e83262d2 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:38.786430 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6449d9-44fd-4351-9b76-ce18e83262d2 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:38.786430 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6449d9-44fd-4351-9b76-ce18e83262d2 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:38.787879 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 434/868] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:38.793365 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b414a-4838-4663-a93f-e25e520f0bd0 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:38.793819 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b414a-4838-4663-a93f-e25e520f0bd0 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:38.793905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b414a-4838-4663-a93f-e25e520f0bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:38.813000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-d05b414a-4838-4663-a93f-e25e520f0bd0 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:38.814201 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-d05b414a-4838-4663-a93f-e25e520f0bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:38.881905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 435/869] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:38 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:38:38.906415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6449d9-44fd-4351-9b76-ce18e83262d2 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:38.925219 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:39.013369 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6449d9-44fd-4351-9b76-ce18e83262d2 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:39.050058 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ec961-d8d4-45ac-be29-35dd8ef74842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:39.050660 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ec961-d8d4-45ac-be29-35dd8ef74842 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:39.050961 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ec961-d8d4-45ac-be29-35dd8ef74842 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:39.051230 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ec961-d8d4-45ac-be29-35dd8ef74842 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:39.061598 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ec961-d8d4-45ac-be29-35dd8ef74842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-1d3ec961-d8d4-45ac-be29-35dd8ef74842 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:39.066316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:39.067274 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:39.068336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:39.068336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:39.068336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:39.068336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:39.068336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:39.068336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:39.068336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:39.068336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:39.068336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:39.068336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:39.068336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:39.068336 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:39.072836 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 435/870] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:38:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:39.075406 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b414a-4838-4663-a93f-e25e520f0bd0 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:39.206088 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b414a-4838-4663-a93f-e25e520f0bd0 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:39.233991 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:39.242951 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef7c16-af74-4d0d-8a1b-4f63b52555a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:39.243575 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef7c16-af74-4d0d-8a1b-4f63b52555a7 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:39.243866 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef7c16-af74-4d0d-8a1b-4f63b52555a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:39.244140 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef7c16-af74-4d0d-8a1b-4f63b52555a7 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:39.244800 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef7c16-af74-4d0d-8a1b-4f63b52555a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:39.245099 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef7c16-af74-4d0d-8a1b-4f63b52555a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:39.246464 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef7c16-af74-4d0d-8a1b-4f63b52555a7 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:39.255415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 436/871] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:39.261678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ec961-d8d4-45ac-be29-35dd8ef74842 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:39.351369 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:39.384109 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ec961-d8d4-45ac-be29-35dd8ef74842 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:39.426123 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e901c2-55aa-41ce-b56d-11cbf3206933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:39.426858 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e901c2-55aa-41ce-b56d-11cbf3206933 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:39.427233 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e901c2-55aa-41ce-b56d-11cbf3206933 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:39.427376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e901c2-55aa-41ce-b56d-11cbf3206933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:39.440954 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e901c2-55aa-41ce-b56d-11cbf3206933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:39.442573 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e901c2-55aa-41ce-b56d-11cbf3206933 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-37e901c2-55aa-41ce-b56d-11cbf3206933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:39.458332 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:39.459545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:39.460605 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:39.460605 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:39.460605 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:39.460605 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 436/872] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:39.465484 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef7c16-af74-4d0d-8a1b-4f63b52555a7 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:39.591557 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef7c16-af74-4d0d-8a1b-4f63b52555a7 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:39.629758 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbf977-523a-4a6e-8b09-ee9104e7f3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:39.630558 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbf977-523a-4a6e-8b09-ee9104e7f3f8 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:39.630862 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbf977-523a-4a6e-8b09-ee9104e7f3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:39.631131 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbf977-523a-4a6e-8b09-ee9104e7f3f8 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:39.631772 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbf977-523a-4a6e-8b09-ee9104e7f3f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:39.632072 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbf977-523a-4a6e-8b09-ee9104e7f3f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:39.633440 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbf977-523a-4a6e-8b09-ee9104e7f3f8 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:39.645951 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 437/873] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:39.652133 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e901c2-55aa-41ce-b56d-11cbf3206933 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:39.768723 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e901c2-55aa-41ce-b56d-11cbf3206933 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:39.799967 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:39.810863 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592833db-9aa9-4539-8648-7a3fd331ff32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:39.811764 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592833db-9aa9-4539-8648-7a3fd331ff32 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:39.812045 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592833db-9aa9-4539-8648-7a3fd331ff32 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:39.812406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592833db-9aa9-4539-8648-7a3fd331ff32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:39.821887 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592833db-9aa9-4539-8648-7a3fd331ff32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:39.823556 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592833db-9aa9-4539-8648-7a3fd331ff32 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-592833db-9aa9-4539-8648-7a3fd331ff32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:39.836104 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:39.837396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:39.838518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:39.838518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:39.838518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:39.838518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:39.838518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:39.838518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:39.838518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:39.838518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:39.838518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:38:39.838518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:39.838518 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 437/874] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:39.845729 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbf977-523a-4a6e-8b09-ee9104e7f3f8 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:39.902900 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:39.960909 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbf977-523a-4a6e-8b09-ee9104e7f3f8 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:39.998492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac257ee-fd3c-498e-b271-4dee80e046a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:39.999315 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac257ee-fd3c-498e-b271-4dee80e046a6 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:39.999687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac257ee-fd3c-498e-b271-4dee80e046a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:39.999963 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac257ee-fd3c-498e-b271-4dee80e046a6 None admin] PATH_INFO: `/v3/users` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:40.000855 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac257ee-fd3c-498e-b271-4dee80e046a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:40.001158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac257ee-fd3c-498e-b271-4dee80e046a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:40.002912 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac257ee-fd3c-498e-b271-4dee80e046a6 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:40.024517 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 438/875] 10.222.0.36 () {56 vars in 1143 bytes} [Sat Aug 6 20:38:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:40.031072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592833db-9aa9-4539-8648-7a3fd331ff32 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:40.161532 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592833db-9aa9-4539-8648-7a3fd331ff32 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:40.200970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615dc8a-e99c-4730-aa94-4a45f3a3ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:40.201698 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615dc8a-e99c-4730-aa94-4a45f3a3ab69 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:40.202107 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615dc8a-e99c-4730-aa94-4a45f3a3ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:40.202404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615dc8a-e99c-4730-aa94-4a45f3a3ab69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:40.267705 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:40.280914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615dc8a-e99c-4730-aa94-4a45f3a3ab69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:40.282695 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615dc8a-e99c-4730-aa94-4a45f3a3ab69 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:40.398246 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 438/876] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:40 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:38:40.404327 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac257ee-fd3c-498e-b271-4dee80e046a6 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:40.520793 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac257ee-fd3c-498e-b271-4dee80e046a6 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:40.532968 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:40.560638 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e6b4a-193a-455d-a0a5-8403286bd502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:40.561278 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e6b4a-193a-455d-a0a5-8403286bd502 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:40.561551 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e6b4a-193a-455d-a0a5-8403286bd502 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:40.561823 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e6b4a-193a-455d-a0a5-8403286bd502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:40.572800 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e6b4a-193a-455d-a0a5-8403286bd502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:40.574506 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e6b4a-193a-455d-a0a5-8403286bd502 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-f88e6b4a-193a-455d-a0a5-8403286bd502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:40.592536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:40.593687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:40.595045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:40.595045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:40.595045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:40.595045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 439/877] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:40.600193 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615dc8a-e99c-4730-aa94-4a45f3a3ab69 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:40.706141 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:40.724283 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615dc8a-e99c-4730-aa94-4a45f3a3ab69 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:40.758894 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef93d0-3999-4467-9458-e9489ce2978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:40.759503 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef93d0-3999-4467-9458-e9489ce2978d None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:40.759778 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef93d0-3999-4467-9458-e9489ce2978d None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:40.760043 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef93d0-3999-4467-9458-e9489ce2978d None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:40.760671 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef93d0-3999-4467-9458-e9489ce2978d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:40.760967 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef93d0-3999-4467-9458-e9489ce2978d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:40.762325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef93d0-3999-4467-9458-e9489ce2978d None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:40.775566 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 439/878] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:40.781961 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e6b4a-193a-455d-a0a5-8403286bd502 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:40.906073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e6b4a-193a-455d-a0a5-8403286bd502 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:40.946401 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6dc8b-5fc9-441f-af8f-08a58cc29112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:40.947163 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6dc8b-5fc9-441f-af8f-08a58cc29112 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:40.947488 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6dc8b-5fc9-441f-af8f-08a58cc29112 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:40.947703 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6dc8b-5fc9-441f-af8f-08a58cc29112 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:40.955346 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6dc8b-5fc9-441f-af8f-08a58cc29112 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:40.956881 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6dc8b-5fc9-441f-af8f-08a58cc29112 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:40.969300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-35d6dc8b-5fc9-441f-af8f-08a58cc29112 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:40.969300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:40.969300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:40.969300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:40.969300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:40.969300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:40.969300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:40.969300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:40.969300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:40.969300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:40.969300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:40.969300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:40.969300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:40.969300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:40.969300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:40.970693 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:40.972110 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:40.972110 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:40.972110 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:40.972110 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:40.972110 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:40.972110 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:40.972110 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:40.972110 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:40.972110 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 440/879] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:40.977359 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef93d0-3999-4467-9458-e9489ce2978d None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:41.103610 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef93d0-3999-4467-9458-e9489ce2978d None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:41.144848 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56872eee-2fa6-44fa-a671-049240b7697f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:41.145746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56872eee-2fa6-44fa-a671-049240b7697f None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:41.146142 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56872eee-2fa6-44fa-a671-049240b7697f None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:41.146415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56872eee-2fa6-44fa-a671-049240b7697f None admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:41.147189 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56872eee-2fa6-44fa-a671-049240b7697f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:41.147607 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56872eee-2fa6-44fa-a671-049240b7697f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:41.149594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56872eee-2fa6-44fa-a671-049240b7697f None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:41.164663 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 440/880] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:41.170951 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6dc8b-5fc9-441f-af8f-08a58cc29112 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:41.196805 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:41.282451 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6dc8b-5fc9-441f-af8f-08a58cc29112 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:41.317812 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad8505-e936-42b0-86c6-23e346fce1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:41.318423 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad8505-e936-42b0-86c6-23e346fce1c8 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:41.318732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad8505-e936-42b0-86c6-23e346fce1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:41.319006 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad8505-e936-42b0-86c6-23e346fce1c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:41.319727 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad8505-e936-42b0-86c6-23e346fce1c8 None admin] RBAC: Adding query filter params (role.id=e62e78acab6b46f6a866b4980700caae, scope.project.id=ce157732829848e59f95d0cd15a897eb, user.id=47953125a0e64fef8f36c17b3504e9e6) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:41.320034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad8505-e936-42b0-86c6-23e346fce1c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:41.321488 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad8505-e936-42b0-86c6-23e346fce1c8 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:41.327013 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 441/881] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:41 2022] GET /identity/v3/role_assignments?user.id=47953125a0e64fef8f36c17b3504e9e6&scope.project.id=ce157732829848e59f95d0cd15a897eb&role.id=e62e78acab6b46f6a866b4980700caae => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:43.526724 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40677c0b-96cd-4b41-85c8-5a42e5d1442a None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:43.527319 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40677c0b-96cd-4b41-85c8-5a42e5d1442a None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:43.527319 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40677c0b-96cd-4b41-85c8-5a42e5d1442a None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:43.528597 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 441/882] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:43.534044 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688ecb0-ec8a-483b-884d-cabe726c9178 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:43.534473 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688ecb0-ec8a-483b-884d-cabe726c9178 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:43.534597 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688ecb0-ec8a-483b-884d-cabe726c9178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:43.553813 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-6688ecb0-ec8a-483b-884d-cabe726c9178 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:43.555082 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-6688ecb0-ec8a-483b-884d-cabe726c9178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:43.637181 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 442/883] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:43 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:38:43.661122 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40677c0b-96cd-4b41-85c8-5a42e5d1442a None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:43.673876 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:43.769778 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40677c0b-96cd-4b41-85c8-5a42e5d1442a None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:43.808030 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b1447-e95c-4354-9a6f-25d040c26ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:43.808659 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b1447-e95c-4354-9a6f-25d040c26ebc None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:43.808931 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b1447-e95c-4354-9a6f-25d040c26ebc None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:43.809196 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b1447-e95c-4354-9a6f-25d040c26ebc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:43.820442 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b1447-e95c-4354-9a6f-25d040c26ebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-4e4b1447-e95c-4354-9a6f-25d040c26ebc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:43.825143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:43.826235 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:43.827312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:43.827312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:43.827312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:43.827312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:43.827312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:43.827312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:43.827312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:43.827312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:43.827312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:43.827312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:43.827312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:43.827312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:43.830766 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 442/884] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:38:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:43.832509 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688ecb0-ec8a-483b-884d-cabe726c9178 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:43.848268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:43.936275 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688ecb0-ec8a-483b-884d-cabe726c9178 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:43.971565 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aea1f-35ad-4b95-b5fa-5bb354446408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:43.972166 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aea1f-35ad-4b95-b5fa-5bb354446408 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:43.972427 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aea1f-35ad-4b95-b5fa-5bb354446408 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:43.972702 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aea1f-35ad-4b95-b5fa-5bb354446408 None admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:43.973344 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35aea1f-35ad-4b95-b5fa-5bb354446408 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:43.973691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35aea1f-35ad-4b95-b5fa-5bb354446408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:43.975207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35aea1f-35ad-4b95-b5fa-5bb354446408 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:43.983227 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 443/885] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:43.989701 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b1447-e95c-4354-9a6f-25d040c26ebc None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:44.060997 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:44.104364 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b1447-e95c-4354-9a6f-25d040c26ebc None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:44.143886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d34a1-1f0f-4f3c-8b60-7c5d3c70f5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:44.144514 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d34a1-1f0f-4f3c-8b60-7c5d3c70f5b4 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:44.144785 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d34a1-1f0f-4f3c-8b60-7c5d3c70f5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:44.145050 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d34a1-1f0f-4f3c-8b60-7c5d3c70f5b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:44.156189 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d34a1-1f0f-4f3c-8b60-7c5d3c70f5b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:44.157632 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d34a1-1f0f-4f3c-8b60-7c5d3c70f5b4 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-e31d34a1-1f0f-4f3c-8b60-7c5d3c70f5b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:44.172902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:44.173969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:44.174981 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:44.174981 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:44.174981 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:44.174981 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 443/886] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:44.180413 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aea1f-35ad-4b95-b5fa-5bb354446408 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:44.264701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:44.294175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aea1f-35ad-4b95-b5fa-5bb354446408 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:44.328687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71368c-a4dc-4c7f-8466-050b4114f668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:44.329215 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71368c-a4dc-4c7f-8466-050b4114f668 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:44.329499 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71368c-a4dc-4c7f-8466-050b4114f668 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:44.329764 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71368c-a4dc-4c7f-8466-050b4114f668 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:44.330391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71368c-a4dc-4c7f-8466-050b4114f668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:44.330717 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71368c-a4dc-4c7f-8466-050b4114f668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:44.332100 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71368c-a4dc-4c7f-8466-050b4114f668 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:44.343840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 444/887] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:44.351664 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d34a1-1f0f-4f3c-8b60-7c5d3c70f5b4 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:44.454071 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d34a1-1f0f-4f3c-8b60-7c5d3c70f5b4 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:44.475423 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:44.490985 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134ad27-587e-4501-97a4-b49d4f41bfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:44.491612 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134ad27-587e-4501-97a4-b49d4f41bfa0 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:44.491882 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134ad27-587e-4501-97a4-b49d4f41bfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:44.492148 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134ad27-587e-4501-97a4-b49d4f41bfa0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:44.499784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134ad27-587e-4501-97a4-b49d4f41bfa0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:44.501217 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134ad27-587e-4501-97a4-b49d4f41bfa0 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-e134ad27-587e-4501-97a4-b49d4f41bfa0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:44.512331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:44.513417 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:44.514522 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:44.514522 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:44.514522 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:44.514522 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:44.514522 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:44.514522 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:44.514522 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:44.514522 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:44.514522 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:38:44.514522 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:44.514522 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 444/888] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:44.521382 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71368c-a4dc-4c7f-8466-050b4114f668 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:44.626519 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71368c-a4dc-4c7f-8466-050b4114f668 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:44.664208 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ed4d8-4554-4e77-95b5-75dc1250762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:44.664798 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ed4d8-4554-4e77-95b5-75dc1250762e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:44.665068 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ed4d8-4554-4e77-95b5-75dc1250762e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:44.665329 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ed4d8-4554-4e77-95b5-75dc1250762e None admin] PATH_INFO: `/v3/users` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:44.666038 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ed4d8-4554-4e77-95b5-75dc1250762e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:44.666342 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ed4d8-4554-4e77-95b5-75dc1250762e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:44.667784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ed4d8-4554-4e77-95b5-75dc1250762e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:44.670617 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:44.685673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 445/889] 10.222.0.36 () {56 vars in 1143 bytes} [Sat Aug 6 20:38:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:44.692079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134ad27-587e-4501-97a4-b49d4f41bfa0 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:44.807191 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134ad27-587e-4501-97a4-b49d4f41bfa0 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:44.845820 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b182a4-8265-41bc-bcf2-6333da11abc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:44.846447 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b182a4-8265-41bc-bcf2-6333da11abc4 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:44.846757 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b182a4-8265-41bc-bcf2-6333da11abc4 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:44.847027 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b182a4-8265-41bc-bcf2-6333da11abc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:44.858256 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b182a4-8265-41bc-bcf2-6333da11abc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:44.859730 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b182a4-8265-41bc-bcf2-6333da11abc4 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-27b182a4-8265-41bc-bcf2-6333da11abc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:44.875096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:44.876989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:44.878713 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:44.878713 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:44.878713 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:44.878713 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 445/890] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:44.882804 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ed4d8-4554-4e77-95b5-75dc1250762e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:44.992021 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ed4d8-4554-4e77-95b5-75dc1250762e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:45.027240 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472829df-228e-4aa7-ab60-93cccaeaa1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:45.027827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472829df-228e-4aa7-ab60-93cccaeaa1ad None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.028102 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472829df-228e-4aa7-ab60-93cccaeaa1ad None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.028361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472829df-228e-4aa7-ab60-93cccaeaa1ad None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.028978 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472829df-228e-4aa7-ab60-93cccaeaa1ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:45.029274 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472829df-228e-4aa7-ab60-93cccaeaa1ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:45.030621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472829df-228e-4aa7-ab60-93cccaeaa1ad None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:45.042111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 446/891] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:45.047921 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b182a4-8265-41bc-bcf2-6333da11abc4 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:45.085330 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:45.160708 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b182a4-8265-41bc-bcf2-6333da11abc4 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:45.195047 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0be80a-8420-4d00-8019-b16c4b4a8962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:45.195671 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0be80a-8420-4d00-8019-b16c4b4a8962 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.195944 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0be80a-8420-4d00-8019-b16c4b4a8962 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.196209 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0be80a-8420-4d00-8019-b16c4b4a8962 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.203219 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0be80a-8420-4d00-8019-b16c4b4a8962 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:45.204661 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0be80a-8420-4d00-8019-b16c4b4a8962 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:45.215914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-be0be80a-8420-4d00-8019-b16c4b4a8962 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:45.215914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:45.215914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:45.215914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:45.215914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:45.215914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:45.215914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:45.215914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:45.215914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:45.215914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:45.215914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:45.215914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:45.215914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:45.215914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:45.215914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:45.216918 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:45.218355 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:45.218355 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:45.218355 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:45.218355 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:45.218355 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:45.218355 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:45.218355 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:45.218355 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:45.218355 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 446/892] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:45.223666 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472829df-228e-4aa7-ab60-93cccaeaa1ad None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:45.282867 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:45.332221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472829df-228e-4aa7-ab60-93cccaeaa1ad None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:45.367020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bd70b-a041-4cd3-b796-81b76958643c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:45.367617 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bd70b-a041-4cd3-b796-81b76958643c None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.367892 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bd70b-a041-4cd3-b796-81b76958643c None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.368154 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bd70b-a041-4cd3-b796-81b76958643c None admin] PATH_INFO: `/v3/projects` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.368826 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bd70b-a041-4cd3-b796-81b76958643c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:45.369127 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bd70b-a041-4cd3-b796-81b76958643c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:45.370543 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bd70b-a041-4cd3-b796-81b76958643c None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:45.382615 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 447/893] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:45.389549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0be80a-8420-4d00-8019-b16c4b4a8962 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:45.488638 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:45.498196 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0be80a-8420-4d00-8019-b16c4b4a8962 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:45.532620 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa1b3e-1216-4306-a3cb-eaa0a6ca0fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:45.533268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa1b3e-1216-4306-a3cb-eaa0a6ca0fd8 None admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.533542 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa1b3e-1216-4306-a3cb-eaa0a6ca0fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.533836 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa1b3e-1216-4306-a3cb-eaa0a6ca0fd8 None admin] PATH_INFO: `/v3/projects/ce157732829848e59f95d0cd15a897eb/users/47953125a0e64fef8f36c17b3504e9e6/roles/e62e78acab6b46f6a866b4980700caae` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.535978 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa1b3e-1216-4306-a3cb-eaa0a6ca0fd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce157732829848e59f95d0cd15a897eb, user_id=47953125a0e64fef8f36c17b3504e9e6, role_id=e62e78acab6b46f6a866b4980700caae)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:45.537561 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa1b3e-1216-4306-a3cb-eaa0a6ca0fd8 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:45.553375 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 447/894] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Aug 6 20:38:45 2022] PUT /identity/v3/projects/ce157732829848e59f95d0cd15a897eb/users/47953125a0e64fef8f36c17b3504e9e6/roles/e62e78acab6b46f6a866b4980700caae => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:47.781967 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f1f36-ef92-445f-a037-1194774d93a1 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:47.782532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f1f36-ef92-445f-a037-1194774d93a1 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:47.782532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f1f36-ef92-445f-a037-1194774d93a1 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:47.783866 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 448/895] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:47.790209 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66b62-3d8a-47eb-b497-42d44313ab07 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:47.790923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66b62-3d8a-47eb-b497-42d44313ab07 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:47.791063 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66b62-3d8a-47eb-b497-42d44313ab07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:47.815550 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-d9d66b62-3d8a-47eb-b497-42d44313ab07 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:47.816749 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-d9d66b62-3d8a-47eb-b497-42d44313ab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:47.891439 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 448/896] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:47 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:38:47.917597 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f1f36-ef92-445f-a037-1194774d93a1 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:48.033921 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f1f36-ef92-445f-a037-1194774d93a1 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:48.047818 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:48.074597 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52c67e-c4e1-49c3-94f5-cc463f77cd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:48.075332 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52c67e-c4e1-49c3-94f5-cc463f77cd0a None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:48.075817 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52c67e-c4e1-49c3-94f5-cc463f77cd0a None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:48.076084 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52c67e-c4e1-49c3-94f5-cc463f77cd0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:48.087327 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52c67e-c4e1-49c3-94f5-cc463f77cd0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-6a52c67e-c4e1-49c3-94f5-cc463f77cd0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:48.092065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:48.092990 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:48.093836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:48.093836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:48.093836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:48.093836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:48.093836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:48.093836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:48.093836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:48.093836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:48.093836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:48.093836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:48.093836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:48.093836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:48.093836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 449/897] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Aug 6 20:38:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:48.100421 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d66b62-3d8a-47eb-b497-42d44313ab07 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:48.207173 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:48.228060 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d66b62-3d8a-47eb-b497-42d44313ab07 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:48.265564 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6662c0-f070-48d1-a753-fcc20d912557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:48.266167 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6662c0-f070-48d1-a753-fcc20d912557 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:48.266446 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6662c0-f070-48d1-a753-fcc20d912557 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:48.266755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6662c0-f070-48d1-a753-fcc20d912557 None admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:48.267415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6662c0-f070-48d1-a753-fcc20d912557 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:48.267716 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6662c0-f070-48d1-a753-fcc20d912557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:48.269085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6662c0-f070-48d1-a753-fcc20d912557 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:48.277304 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 449/898] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:48.283434 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52c67e-c4e1-49c3-94f5-cc463f77cd0a None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:48.389150 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52c67e-c4e1-49c3-94f5-cc463f77cd0a None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:48.427414 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65909528-92c2-49e3-8852-9b8ce73fcd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:48.428031 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65909528-92c2-49e3-8852-9b8ce73fcd5e None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:48.428299 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65909528-92c2-49e3-8852-9b8ce73fcd5e None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:48.428554 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65909528-92c2-49e3-8852-9b8ce73fcd5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:48.438568 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65909528-92c2-49e3-8852-9b8ce73fcd5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:48.440042 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65909528-92c2-49e3-8852-9b8ce73fcd5e None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-65909528-92c2-49e3-8852-9b8ce73fcd5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:48.454479 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:48.455546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:48.456533 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:48.456533 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:48.456533 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:48.456533 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 450/899] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:48.462651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6662c0-f070-48d1-a753-fcc20d912557 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:48.585424 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6662c0-f070-48d1-a753-fcc20d912557 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:48.620592 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf50f46-1ae4-434f-8294-ac3899bfbfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:48.621182 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf50f46-1ae4-434f-8294-ac3899bfbfbd None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:48.621453 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf50f46-1ae4-434f-8294-ac3899bfbfbd None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:48.621720 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf50f46-1ae4-434f-8294-ac3899bfbfbd None admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:48.622351 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf50f46-1ae4-434f-8294-ac3899bfbfbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:48.622641 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf50f46-1ae4-434f-8294-ac3899bfbfbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:48.624023 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf50f46-1ae4-434f-8294-ac3899bfbfbd None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:48.636511 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 450/900] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:48.645683 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65909528-92c2-49e3-8852-9b8ce73fcd5e None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:48.673922 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:48.748458 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65909528-92c2-49e3-8852-9b8ce73fcd5e None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:48.783037 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a27c08-46f6-4fe7-bb8c-1ce1206eedfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:48.783624 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a27c08-46f6-4fe7-bb8c-1ce1206eedfa None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:48.783917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a27c08-46f6-4fe7-bb8c-1ce1206eedfa None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:48.784185 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a27c08-46f6-4fe7-bb8c-1ce1206eedfa None admin] PATH_INFO: `/v3/users/placement` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:48.791869 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a27c08-46f6-4fe7-bb8c-1ce1206eedfa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:48.793306 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a27c08-46f6-4fe7-bb8c-1ce1206eedfa None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-83a27c08-46f6-4fe7-bb8c-1ce1206eedfa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:48.804480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:48.805579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:48.806746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:48.806746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:48.806746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:48.806746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:48.806746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:48.806746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:48.806746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:48.806746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:48.806746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:38:48.806746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:48.806746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 451/901] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:48.811589 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf50f46-1ae4-434f-8294-ac3899bfbfbd None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:48.815526 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:48.920414 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf50f46-1ae4-434f-8294-ac3899bfbfbd None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:48.957862 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478e241-6a0f-4633-95b2-3768949932e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:48.958625 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478e241-6a0f-4633-95b2-3768949932e3 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:48.958812 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478e241-6a0f-4633-95b2-3768949932e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:48.959081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478e241-6a0f-4633-95b2-3768949932e3 None admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:48.959806 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478e241-6a0f-4633-95b2-3768949932e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:48.960108 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478e241-6a0f-4633-95b2-3768949932e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:48.961536 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478e241-6a0f-4633-95b2-3768949932e3 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:48.979080 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 451/902] 10.222.0.36 () {56 vars in 1143 bytes} [Sat Aug 6 20:38:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:48.985771 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a27c08-46f6-4fe7-bb8c-1ce1206eedfa None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:49.087034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:49.103325 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a27c08-46f6-4fe7-bb8c-1ce1206eedfa None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:49.138442 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d2e27-9a5f-40bf-a942-4e05026d02ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:49.139074 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d2e27-9a5f-40bf-a942-4e05026d02ae None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:49.139350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d2e27-9a5f-40bf-a942-4e05026d02ae None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:49.139614 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d2e27-9a5f-40bf-a942-4e05026d02ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:49.220877 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d2e27-9a5f-40bf-a942-4e05026d02ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:49.222279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d2e27-9a5f-40bf-a942-4e05026d02ae None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:49.315006 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:49.332409 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 452/903] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:48 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 20:38:49.338870 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478e241-6a0f-4633-95b2-3768949932e3 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:49.406603 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:49.447920 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478e241-6a0f-4633-95b2-3768949932e3 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:49.485333 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2da273-3236-408a-b1f4-ccf80578ad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:49.485968 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2da273-3236-408a-b1f4-ccf80578ad6e None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:49.486238 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2da273-3236-408a-b1f4-ccf80578ad6e None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:49.486499 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2da273-3236-408a-b1f4-ccf80578ad6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:49.497029 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2da273-3236-408a-b1f4-ccf80578ad6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:49.498453 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2da273-3236-408a-b1f4-ccf80578ad6e None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-ab2da273-3236-408a-b1f4-ccf80578ad6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:49.512983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:49.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:49.515335 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:49.515335 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:49.515335 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:49.515335 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 452/904] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:49.519938 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d2e27-9a5f-40bf-a942-4e05026d02ae None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:49.620592 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d2e27-9a5f-40bf-a942-4e05026d02ae None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:49.655445 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839f39e-ad71-43d0-9fa9-219325cc51c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:49.656029 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839f39e-ad71-43d0-9fa9-219325cc51c1 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:49.656264 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839f39e-ad71-43d0-9fa9-219325cc51c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:49.656547 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839f39e-ad71-43d0-9fa9-219325cc51c1 None admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:49.657169 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839f39e-ad71-43d0-9fa9-219325cc51c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:49.657466 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839f39e-ad71-43d0-9fa9-219325cc51c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:49.658854 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839f39e-ad71-43d0-9fa9-219325cc51c1 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:49.676324 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 453/905] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:49.685302 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2da273-3236-408a-b1f4-ccf80578ad6e None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:49.789933 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2da273-3236-408a-b1f4-ccf80578ad6e None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:49.804506 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:49.827573 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c26c6-1611-49a2-a1d2-3e121237a6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:49.828167 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c26c6-1611-49a2-a1d2-3e121237a6a1 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:49.828436 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c26c6-1611-49a2-a1d2-3e121237a6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:49.828699 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c26c6-1611-49a2-a1d2-3e121237a6a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:49.835872 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c26c6-1611-49a2-a1d2-3e121237a6a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:49.837295 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c26c6-1611-49a2-a1d2-3e121237a6a1 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:49.848886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application [None req-233c26c6-1611-49a2-a1d2-3e121237a6a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:49.848886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:49.848886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:49.848886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:49.848886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:49.848886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:49.848886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:49.848886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:49.848886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:49.848886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:49.848886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:49.848886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:49.848886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:49.848886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:49.848886 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:49.849982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:49.850998 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:49.850998 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:49.850998 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:49.850998 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:49.850998 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:49.850998 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:49.850998 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:49.850998 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: ERROR keystone.server.flask.application Aug 06 20:38:49.850998 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 453/906] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:49.857729 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839f39e-ad71-43d0-9fa9-219325cc51c1 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:49.908961 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:49.971776 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839f39e-ad71-43d0-9fa9-219325cc51c1 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:50.008320 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbb5d7-e5bb-4e6e-9d58-9f85ceeb2836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:50.009297 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbb5d7-e5bb-4e6e-9d58-9f85ceeb2836 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:50.009750 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbb5d7-e5bb-4e6e-9d58-9f85ceeb2836 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:50.010192 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbb5d7-e5bb-4e6e-9d58-9f85ceeb2836 None admin] PATH_INFO: `/v3/projects` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:50.011371 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbb5d7-e5bb-4e6e-9d58-9f85ceeb2836 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:50.011866 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbb5d7-e5bb-4e6e-9d58-9f85ceeb2836 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:50.014162 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbb5d7-e5bb-4e6e-9d58-9f85ceeb2836 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:50.029508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 454/907] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:50.035921 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c26c6-1611-49a2-a1d2-3e121237a6a1 None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:50.164817 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c26c6-1611-49a2-a1d2-3e121237a6a1 None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:50.200041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab0606-2e44-4979-910b-5a4de9b5d08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:50.200634 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab0606-2e44-4979-910b-5a4de9b5d08c None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:50.200910 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab0606-2e44-4979-910b-5a4de9b5d08c None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:50.201185 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab0606-2e44-4979-910b-5a4de9b5d08c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:50.201896 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab0606-2e44-4979-910b-5a4de9b5d08c None admin] RBAC: Adding query filter params (role.id=e62e78acab6b46f6a866b4980700caae, scope.project.id=ce157732829848e59f95d0cd15a897eb, user.id=47953125a0e64fef8f36c17b3504e9e6) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:50.202206 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab0606-2e44-4979-910b-5a4de9b5d08c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:50.203646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab0606-2e44-4979-910b-5a4de9b5d08c None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:50.209911 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 454/908] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:50 2022] GET /identity/v3/role_assignments?user.id=47953125a0e64fef8f36c17b3504e9e6&scope.project.id=ce157732829848e59f95d0cd15a897eb&role.id=e62e78acab6b46f6a866b4980700caae => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:52.480768 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757e5ec-d8ff-494b-b2c0-8a958776c5f5 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.481197 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757e5ec-d8ff-494b-b2c0-8a958776c5f5 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.481317 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757e5ec-d8ff-494b-b2c0-8a958776c5f5 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.482697 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 455/909] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:52.487927 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f62b-536c-47f9-8906-6b940beb4c54 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.488362 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f62b-536c-47f9-8906-6b940beb4c54 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.488462 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f62b-536c-47f9-8906-6b940beb4c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.509324 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-5e38f62b-536c-47f9-8906-6b940beb4c54 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:52.510488 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-5e38f62b-536c-47f9-8906-6b940beb4c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:52.542898 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:52.593189 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 455/910] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:52 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:38:52.618493 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757e5ec-d8ff-494b-b2c0-8a958776c5f5 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:52.736247 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757e5ec-d8ff-494b-b2c0-8a958776c5f5 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:52.744356 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:52.773047 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a8c35-a00a-4d8f-a4ae-d2aca89d378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:52.773669 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a8c35-a00a-4d8f-a4ae-d2aca89d378a None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.773945 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a8c35-a00a-4d8f-a4ae-d2aca89d378a None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.774217 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a8c35-a00a-4d8f-a4ae-d2aca89d378a None admin] PATH_INFO: `/v3/services/placement` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.774819 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a8c35-a00a-4d8f-a4ae-d2aca89d378a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:52.776199 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a8c35-a00a-4d8f-a4ae-d2aca89d378a None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-b08a8c35-a00a-4d8f-a4ae-d2aca89d378a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:52.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:52.788258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:52.788258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:52.788258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:52.788258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:52.788258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:52.788258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:52.788258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:52.788258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:52.788258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:52.788258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:52.788258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:38:52.788258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:38:52.788258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:38:52.788258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:52.788258 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 456/911] 10.222.0.36 () {56 vars in 1117 bytes} [Sat Aug 6 20:38:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:52.794617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38f62b-536c-47f9-8906-6b940beb4c54 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:52.913493 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38f62b-536c-47f9-8906-6b940beb4c54 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:52.951181 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05186262-4486-4ecc-9ba2-aaa320d9785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:52.951788 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05186262-4486-4ecc-9ba2-aaa320d9785d None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.952058 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05186262-4486-4ecc-9ba2-aaa320d9785d None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.952322 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05186262-4486-4ecc-9ba2-aaa320d9785d None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.952943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05186262-4486-4ecc-9ba2-aaa320d9785d None admin] RBAC: Adding query filter params (name=placement) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:52.953238 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05186262-4486-4ecc-9ba2-aaa320d9785d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:52.954626 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05186262-4486-4ecc-9ba2-aaa320d9785d None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:52.959579 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 456/912] 10.222.0.36 () {56 vars in 1116 bytes} [Sat Aug 6 20:38:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:52.966022 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a8c35-a00a-4d8f-a4ae-d2aca89d378a None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:53.100213 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a8c35-a00a-4d8f-a4ae-d2aca89d378a None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:53.142203 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d14cd5-b317-4fe2-ad3b-f3a4153fc427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:53.142992 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d14cd5-b317-4fe2-ad3b-f3a4153fc427 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:53.143377 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d14cd5-b317-4fe2-ad3b-f3a4153fc427 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:53.143681 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d14cd5-b317-4fe2-ad3b-f3a4153fc427 None admin] PATH_INFO: `/v3/services` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:53.144347 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d14cd5-b317-4fe2-ad3b-f3a4153fc427 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:53.144786 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d14cd5-b317-4fe2-ad3b-f3a4153fc427 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:53.146380 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d14cd5-b317-4fe2-ad3b-f3a4153fc427 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:53.152399 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 457/913] 10.222.0.36 () {56 vars in 1116 bytes} [Sat Aug 6 20:38:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:55.345184 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a9b44-91bc-438d-bbb7-5df29e01ea1c None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.345780 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a9b44-91bc-438d-bbb7-5df29e01ea1c None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.345780 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a9b44-91bc-438d-bbb7-5df29e01ea1c None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.347116 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 457/914] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:55.353528 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4aa17-d144-4449-8976-2b9c42b1fc37 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.354218 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4aa17-d144-4449-8976-2b9c42b1fc37 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.354374 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4aa17-d144-4449-8976-2b9c42b1fc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.378042 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-6fd4aa17-d144-4449-8976-2b9c42b1fc37 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:55.379259 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-6fd4aa17-d144-4449-8976-2b9c42b1fc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:55.409673 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:55.451375 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 458/915] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:55 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:38:55.476343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a9b44-91bc-438d-bbb7-5df29e01ea1c None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:55.510932 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:55.587353 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a9b44-91bc-438d-bbb7-5df29e01ea1c None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:55.623817 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c474c1-35bc-4de8-8e10-b2fe99787cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:55.624349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c474c1-35bc-4de8-8e10-b2fe99787cac None admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.624624 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c474c1-35bc-4de8-8e10-b2fe99787cac None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.624897 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c474c1-35bc-4de8-8e10-b2fe99787cac None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.625532 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c474c1-35bc-4de8-8e10-b2fe99787cac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:55.626925 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c474c1-35bc-4de8-8e10-b2fe99787cac None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:55.643826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 458/916] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Aug 6 20:38:55 2022] POST /identity/v3/services => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:38:57.864656 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528470f-07e1-411d-ad5d-137199533213 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:57.865483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528470f-07e1-411d-ad5d-137199533213 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:57.865613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528470f-07e1-411d-ad5d-137199533213 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:57.867735 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 459/917] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:38:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:57.873902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822217f-b500-493b-a68a-db2272ce8888 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:57.874348 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822217f-b500-493b-a68a-db2272ce8888 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:57.874474 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822217f-b500-493b-a68a-db2272ce8888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:57.895482 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-8822217f-b500-493b-a68a-db2272ce8888 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:57.896786 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-8822217f-b500-493b-a68a-db2272ce8888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:57.972869 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 459/918] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:57 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:38:57.996442 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528470f-07e1-411d-ad5d-137199533213 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.121466 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528470f-07e1-411d-ad5d-137199533213 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.162368 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e55f17-b5c0-433e-9ca7-2a1fd7cf4c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.163245 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e55f17-b5c0-433e-9ca7-2a1fd7cf4c9d None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.163654 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e55f17-b5c0-433e-9ca7-2a1fd7cf4c9d None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.164024 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e55f17-b5c0-433e-9ca7-2a1fd7cf4c9d None admin] PATH_INFO: `/v3/services/placement` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.164600 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e55f17-b5c0-433e-9ca7-2a1fd7cf4c9d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.165985 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e55f17-b5c0-433e-9ca7-2a1fd7cf4c9d None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-32e55f17-b5c0-433e-9ca7-2a1fd7cf4c9d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:58.175663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:58.176740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:58.178020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:58.178020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:58.178020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:58.178020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:58.178020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:58.178020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:58.178020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:58.178020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:58.178020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:58.178020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:58.178020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:38:58.178020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:38:58.178020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:38:58.178020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:38:58.178020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 460/919] 10.222.0.36 () {56 vars in 1117 bytes} [Sat Aug 6 20:38:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:58.185623 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822217f-b500-493b-a68a-db2272ce8888 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.205839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:58.291845 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822217f-b500-493b-a68a-db2272ce8888 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.327296 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7200ee6-fd71-4c4a-9a45-b4efcdb1bf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.327897 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7200ee6-fd71-4c4a-9a45-b4efcdb1bf9b None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.328166 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7200ee6-fd71-4c4a-9a45-b4efcdb1bf9b None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.328434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7200ee6-fd71-4c4a-9a45-b4efcdb1bf9b None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.329058 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7200ee6-fd71-4c4a-9a45-b4efcdb1bf9b None admin] RBAC: Adding query filter params (name=placement) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:58.329356 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7200ee6-fd71-4c4a-9a45-b4efcdb1bf9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.330769 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7200ee6-fd71-4c4a-9a45-b4efcdb1bf9b None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.336013 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 460/920] 10.222.0.36 () {56 vars in 1116 bytes} [Sat Aug 6 20:38:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:58.343144 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e55f17-b5c0-433e-9ca7-2a1fd7cf4c9d None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.382240 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:58.458115 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e55f17-b5c0-433e-9ca7-2a1fd7cf4c9d None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.502623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f1ecd-1922-461a-bc8b-427a591bc2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.503253 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f1ecd-1922-461a-bc8b-427a591bc2c6 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.503523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f1ecd-1922-461a-bc8b-427a591bc2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.503795 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f1ecd-1922-461a-bc8b-427a591bc2c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.504487 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f1ecd-1922-461a-bc8b-427a591bc2c6 None admin] RBAC: Adding query filter params (interface=public, service_id=27c2d8786efd4386b50c1f471900edfd, region_id=RegionOne) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:58.504795 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f1ecd-1922-461a-bc8b-427a591bc2c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.506270 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f1ecd-1922-461a-bc8b-427a591bc2c6 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.511383 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 461/921] 10.222.0.36 () {56 vars in 1251 bytes} [Sat Aug 6 20:38:58 2022] GET /identity/v3/endpoints?service_id=27c2d8786efd4386b50c1f471900edfd&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:58.517858 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7200ee6-fd71-4c4a-9a45-b4efcdb1bf9b None admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.598091 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:58.617642 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7200ee6-fd71-4c4a-9a45-b4efcdb1bf9b None admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.652206 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66e621-5d21-42c7-9fb6-1d9552fb6ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.652743 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66e621-5d21-42c7-9fb6-1d9552fb6ed0 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.653022 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66e621-5d21-42c7-9fb6-1d9552fb6ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.653285 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66e621-5d21-42c7-9fb6-1d9552fb6ed0 None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.653882 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66e621-5d21-42c7-9fb6-1d9552fb6ed0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.655271 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66e621-5d21-42c7-9fb6-1d9552fb6ed0 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.662156 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 461/922] 10.222.0.36 () {56 vars in 1087 bytes} [Sat Aug 6 20:38:58 2022] GET /identity/v3/services => generated 1962 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:39:00.879546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59052743-121e-4da1-95ef-33789746eb44 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.880468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59052743-121e-4da1-95ef-33789746eb44 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.880468 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59052743-121e-4da1-95ef-33789746eb44 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.881801 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 462/923] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:00.887168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d8926-0c29-4584-bc74-9592ccd07560 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.887584 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d8926-0c29-4584-bc74-9592ccd07560 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.887733 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d8926-0c29-4584-bc74-9592ccd07560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.908768 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-663d8926-0c29-4584-bc74-9592ccd07560 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:00.909939 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-663d8926-0c29-4584-bc74-9592ccd07560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:00.983288 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 462/924] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:00 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:01.008009 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59052743-121e-4da1-95ef-33789746eb44 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.132766 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:01.145209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59052743-121e-4da1-95ef-33789746eb44 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.189216 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4701387-af2a-40ee-a74e-63d3daaca716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.189837 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4701387-af2a-40ee-a74e-63d3daaca716 None admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.190110 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4701387-af2a-40ee-a74e-63d3daaca716 None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.190377 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4701387-af2a-40ee-a74e-63d3daaca716 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.191011 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4701387-af2a-40ee-a74e-63d3daaca716 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.192412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4701387-af2a-40ee-a74e-63d3daaca716 None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application [None req-f4701387-af2a-40ee-a74e-63d3daaca716 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:01.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:01.202516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:01.203784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:01.203784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:01.203784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:01.203784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:01.203784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:01.203784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:01.203784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:01.203784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:01.203784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:01.203784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:01.203784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:01.203784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:01.203784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:39:01.203784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: ERROR keystone.server.flask.application Aug 06 20:39:01.203784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 463/925] 10.222.0.36 () {56 vars in 1117 bytes} [Sat Aug 6 20:39:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:01.210612 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d8926-0c29-4584-bc74-9592ccd07560 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.288303 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:01.312215 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d8926-0c29-4584-bc74-9592ccd07560 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.350374 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f02a37-cf32-446c-b2bd-51b283f543b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.351011 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f02a37-cf32-446c-b2bd-51b283f543b6 None admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.351285 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f02a37-cf32-446c-b2bd-51b283f543b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.351554 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f02a37-cf32-446c-b2bd-51b283f543b6 None admin] PATH_INFO: `/v3/services` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.352185 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f02a37-cf32-446c-b2bd-51b283f543b6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:01.352487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f02a37-cf32-446c-b2bd-51b283f543b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.353847 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f02a37-cf32-446c-b2bd-51b283f543b6 None admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.358959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 463/926] 10.222.0.36 () {56 vars in 1116 bytes} [Sat Aug 6 20:39:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:01.365570 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4701387-af2a-40ee-a74e-63d3daaca716 None admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.483300 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4701387-af2a-40ee-a74e-63d3daaca716 None admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.525405 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788ae9e-3ccc-4d75-9646-c0d4593ff66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.526010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788ae9e-3ccc-4d75-9646-c0d4593ff66a None admin] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.526286 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788ae9e-3ccc-4d75-9646-c0d4593ff66a None admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.526610 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788ae9e-3ccc-4d75-9646-c0d4593ff66a None admin] PATH_INFO: `/v3/endpoints` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.527248 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788ae9e-3ccc-4d75-9646-c0d4593ff66a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.528625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788ae9e-3ccc-4d75-9646-c0d4593ff66a None admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.555999 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 464/927] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:01 2022] POST /identity/v3/endpoints => generated 331 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:11.356075 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=30 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:11.548639 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:00.678835 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dba17c-81e8-42c3-9e11-0e20ddf87ba2 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:00.679406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dba17c-81e8-42c3-9e11-0e20ddf87ba2 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:00.679406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dba17c-81e8-42c3-9e11-0e20ddf87ba2 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:00.681033 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 464/928] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:00.687861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23e4cf-49e1-4c2d-ac28-8c6497b823d4 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:00.688340 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23e4cf-49e1-4c2d-ac28-8c6497b823d4 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:00.688420 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23e4cf-49e1-4c2d-ac28-8c6497b823d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:00.712865 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-7b23e4cf-49e1-4c2d-ac28-8c6497b823d4 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:00.714130 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-7b23e4cf-49e1-4c2d-ac28-8c6497b823d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:00.798073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 465/929] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:00.846865 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b7cfb-c939-42ac-9f20-d7b9a57d6c09 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:00.848555 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b7cfb-c939-42ac-9f20-d7b9a57d6c09 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:00.848810 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b7cfb-c939-42ac-9f20-d7b9a57d6c09 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:00.850658 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 465/930] 10.222.0.36 () {54 vars in 965 bytes} [Sat Aug 6 20:40:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:00.865092 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0329e-a2fd-4f28-98c8-9bfb8c68b0e6 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:00.865316 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0329e-a2fd-4f28-98c8-9bfb8c68b0e6 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:00.865579 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0329e-a2fd-4f28-98c8-9bfb8c68b0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:00.928434 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-e1c0329e-a2fd-4f28-98c8-9bfb8c68b0e6 None None] MFA Rules not processed for user `471f571c16f9434e924b3a4589340db4`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:00.929480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-e1c0329e-a2fd-4f28-98c8-9bfb8c68b0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:01.003691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 466/931] 10.222.0.36 () {58 vars in 1062 bytes} [Sat Aug 6 20:40:00 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:01.012122 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b7cfb-c939-42ac-9f20-d7b9a57d6c09 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:01.025816 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b7cfb-c939-42ac-9f20-d7b9a57d6c09 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:01.029942 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8e5f4-b195-4b75-83d4-13f988d3ea0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:01.030806 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8e5f4-b195-4b75-83d4-13f988d3ea0a service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:01.031176 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8e5f4-b195-4b75-83d4-13f988d3ea0a service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:01.031549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8e5f4-b195-4b75-83d4-13f988d3ea0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:01.043170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8e5f4-b195-4b75-83d4-13f988d3ea0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:01.044904 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8e5f4-b195-4b75-83d4-13f988d3ea0a service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:01.057256 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 466/932] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:03.513318 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a51f42-2c28-4f4a-8566-171de14a9962 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:03.513838 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a51f42-2c28-4f4a-8566-171de14a9962 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:03.513838 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a51f42-2c28-4f4a-8566-171de14a9962 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:03.515199 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 467/933] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:03.520394 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fece1-1b2d-4b87-a451-6a915628c8be None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:03.520783 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fece1-1b2d-4b87-a451-6a915628c8be None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:03.520928 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fece1-1b2d-4b87-a451-6a915628c8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:03.541748 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-0c4fece1-1b2d-4b87-a451-6a915628c8be None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:03.542949 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-0c4fece1-1b2d-4b87-a451-6a915628c8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:03.551077 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 467/934] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:03.591623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a51f42-2c28-4f4a-8566-171de14a9962 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:03.603450 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a51f42-2c28-4f4a-8566-171de14a9962 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:03.606965 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bea1d-83a6-486d-8e50-21eb93ba40c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:03.607713 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bea1d-83a6-486d-8e50-21eb93ba40c0 service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:03.608074 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bea1d-83a6-486d-8e50-21eb93ba40c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:03.608500 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bea1d-83a6-486d-8e50-21eb93ba40c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:03.618486 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bea1d-83a6-486d-8e50-21eb93ba40c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:03.619966 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bea1d-83a6-486d-8e50-21eb93ba40c0 service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:03.629114 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 468/935] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:06.253220 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0470ef-21e8-463f-ae1a-3a8aad0ea33f None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:06.253750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0470ef-21e8-463f-ae1a-3a8aad0ea33f None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:06.253750 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0470ef-21e8-463f-ae1a-3a8aad0ea33f None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:06.255138 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 468/936] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:06.260481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755b556-53f0-47fe-86f3-26ae8fee5328 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:06.260862 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755b556-53f0-47fe-86f3-26ae8fee5328 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:06.261069 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755b556-53f0-47fe-86f3-26ae8fee5328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:06.300008 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-4755b556-53f0-47fe-86f3-26ae8fee5328 None None] MFA Rules not processed for user `f074eceaddb146fab56e8b5769451851`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:06.301213 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-4755b556-53f0-47fe-86f3-26ae8fee5328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:06.344267 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:06.375296 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 469/937] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:06 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:06.430472 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c27e2f-273a-454c-b3f7-f547a4311a57 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:06.430806 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c27e2f-273a-454c-b3f7-f547a4311a57 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:06.431075 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c27e2f-273a-454c-b3f7-f547a4311a57 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:06.432411 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 469/938] 10.222.0.36 () {54 vars in 965 bytes} [Sat Aug 6 20:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:06.438830 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133924b-9795-44ad-aa12-b68a6587ecd9 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:06.439116 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133924b-9795-44ad-aa12-b68a6587ecd9 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:06.439389 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133924b-9795-44ad-aa12-b68a6587ecd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:06.459983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-2133924b-9795-44ad-aa12-b68a6587ecd9 None None] MFA Rules not processed for user `471f571c16f9434e924b3a4589340db4`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:06.461282 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-2133924b-9795-44ad-aa12-b68a6587ecd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:06.469212 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 470/939] 10.222.0.36 () {58 vars in 1062 bytes} [Sat Aug 6 20:40:06 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:06.479876 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c27e2f-273a-454c-b3f7-f547a4311a57 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:06.495599 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c27e2f-273a-454c-b3f7-f547a4311a57 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:06.500591 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e442ba-eb3c-4a3f-aca8-6bfac4e4664b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:06.501211 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e442ba-eb3c-4a3f-aca8-6bfac4e4664b service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:06.501484 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e442ba-eb3c-4a3f-aca8-6bfac4e4664b service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:06.501746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e442ba-eb3c-4a3f-aca8-6bfac4e4664b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:06.511971 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e442ba-eb3c-4a3f-aca8-6bfac4e4664b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:06.513400 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e442ba-eb3c-4a3f-aca8-6bfac4e4664b service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:06.522612 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 470/940] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:06 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:09.681801 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87992a1-9b4c-43b9-8ea3-6e7a13ad6e65 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:09.682411 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87992a1-9b4c-43b9-8ea3-6e7a13ad6e65 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:09.682411 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87992a1-9b4c-43b9-8ea3-6e7a13ad6e65 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:09.683694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 471/941] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:09.690051 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa0b71-1aea-4217-b230-bcabf1cb5d01 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:09.690849 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa0b71-1aea-4217-b230-bcabf1cb5d01 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:09.690979 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa0b71-1aea-4217-b230-bcabf1cb5d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:09.716617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-25aa0b71-1aea-4217-b230-bcabf1cb5d01 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:09.718448 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-25aa0b71-1aea-4217-b230-bcabf1cb5d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:09.802624 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 471/942] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:09 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:09.842912 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87992a1-9b4c-43b9-8ea3-6e7a13ad6e65 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:09.855945 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87992a1-9b4c-43b9-8ea3-6e7a13ad6e65 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:09.859834 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0578c0-b6ce-4c7d-98dd-fd633a4a4876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:09.860430 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0578c0-b6ce-4c7d-98dd-fd633a4a4876 service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:09.860696 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0578c0-b6ce-4c7d-98dd-fd633a4a4876 service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:09.860958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0578c0-b6ce-4c7d-98dd-fd633a4a4876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:09.870202 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0578c0-b6ce-4c7d-98dd-fd633a4a4876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:09.871669 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0578c0-b6ce-4c7d-98dd-fd633a4a4876 service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:09.880903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 472/943] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:09 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:12.812391 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb5c9c-a83b-45ba-be88-f087a0bcbea6 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:12.812953 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb5c9c-a83b-45ba-be88-f087a0bcbea6 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:12.812953 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb5c9c-a83b-45ba-be88-f087a0bcbea6 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:12.814254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 472/944] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:12.819620 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e129b7f-6b48-40ab-b7a6-ac3bab2fc690 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:12.820111 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e129b7f-6b48-40ab-b7a6-ac3bab2fc690 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:12.820202 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e129b7f-6b48-40ab-b7a6-ac3bab2fc690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:12.840453 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-8e129b7f-6b48-40ab-b7a6-ac3bab2fc690 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:12.841650 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-8e129b7f-6b48-40ab-b7a6-ac3bab2fc690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:12.850892 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 473/945] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:12.889312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb5c9c-a83b-45ba-be88-f087a0bcbea6 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:12.900772 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb5c9c-a83b-45ba-be88-f087a0bcbea6 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:12.904558 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c1024-c631-44d3-a196-c489844c8964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:12.905216 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c1024-c631-44d3-a196-c489844c8964 service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:12.905495 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c1024-c631-44d3-a196-c489844c8964 service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:12.905763 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c1024-c631-44d3-a196-c489844c8964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:12.915390 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c1024-c631-44d3-a196-c489844c8964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:12.916824 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c1024-c631-44d3-a196-c489844c8964 service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:12.926645 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 473/946] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:15.194182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0549e-e0b0-445a-9f97-d89803caad88 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:15.194766 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0549e-e0b0-445a-9f97-d89803caad88 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:15.194766 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0549e-e0b0-445a-9f97-d89803caad88 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:15.197022 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 474/947] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:15.204756 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f6a1c-ccd4-414f-a08a-e553878e5c30 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:15.205267 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f6a1c-ccd4-414f-a08a-e553878e5c30 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:15.205366 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f6a1c-ccd4-414f-a08a-e553878e5c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:15.225959 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-1d7f6a1c-ccd4-414f-a08a-e553878e5c30 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:15.227265 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-1d7f6a1c-ccd4-414f-a08a-e553878e5c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:15.235583 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 474/948] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:40:15.273839 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0549e-e0b0-445a-9f97-d89803caad88 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:15.285083 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0549e-e0b0-445a-9f97-d89803caad88 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:15.288957 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ba9f7-2b4d-4b0c-a6d7-39e3682f2f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:15.289637 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ba9f7-2b4d-4b0c-a6d7-39e3682f2f20 service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:15.289924 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ba9f7-2b4d-4b0c-a6d7-39e3682f2f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:15.290194 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ba9f7-2b4d-4b0c-a6d7-39e3682f2f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:15.300388 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ba9f7-2b4d-4b0c-a6d7-39e3682f2f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:15.301833 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ba9f7-2b4d-4b0c-a6d7-39e3682f2f20 service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:15.312043 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 475/949] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:17.580298 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567d915-6a3f-4826-9299-3c93286fc412 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:17.580831 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567d915-6a3f-4826-9299-3c93286fc412 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:17.580831 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567d915-6a3f-4826-9299-3c93286fc412 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:17.582194 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 475/950] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:17.587664 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ec315-6bb2-4493-a137-b0ad0d9513cd None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:17.588179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ec315-6bb2-4493-a137-b0ad0d9513cd None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:17.588179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ec315-6bb2-4493-a137-b0ad0d9513cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:17.609157 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-5c7ec315-6bb2-4493-a137-b0ad0d9513cd None None] MFA Rules not processed for user `f074eceaddb146fab56e8b5769451851`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:17.610389 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-5c7ec315-6bb2-4493-a137-b0ad0d9513cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:17.620176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 476/951] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:17 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:17.659621 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567d915-6a3f-4826-9299-3c93286fc412 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:17.672267 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567d915-6a3f-4826-9299-3c93286fc412 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:17.676201 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec00a6-0cdc-417d-aa95-dffac5482271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:17.676799 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec00a6-0cdc-417d-aa95-dffac5482271 service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:17.677066 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec00a6-0cdc-417d-aa95-dffac5482271 service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:17.677298 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec00a6-0cdc-417d-aa95-dffac5482271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:17.687166 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec00a6-0cdc-417d-aa95-dffac5482271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:17.688577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec00a6-0cdc-417d-aa95-dffac5482271 service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:17.698251 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 476/952] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:17 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:20.151937 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723e3f2-70eb-4a26-b1fe-3699d68706bc None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:20.152472 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723e3f2-70eb-4a26-b1fe-3699d68706bc None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:20.152760 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723e3f2-70eb-4a26-b1fe-3699d68706bc None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:20.154025 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 477/953] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:20.159989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffff606-6606-4fa9-8a26-4797074fd2cb None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:20.160567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffff606-6606-4fa9-8a26-4797074fd2cb None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:20.160567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffff606-6606-4fa9-8a26-4797074fd2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:20.182163 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-2ffff606-6606-4fa9-8a26-4797074fd2cb None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:20.183517 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-2ffff606-6606-4fa9-8a26-4797074fd2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:20.194065 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 477/954] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:20.231064 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723e3f2-70eb-4a26-b1fe-3699d68706bc None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:20.243727 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723e3f2-70eb-4a26-b1fe-3699d68706bc None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:20.247638 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a4971-a2a4-4bb8-b09b-8eba24435186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:20.248278 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a4971-a2a4-4bb8-b09b-8eba24435186 service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:20.248484 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a4971-a2a4-4bb8-b09b-8eba24435186 service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:20.248778 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a4971-a2a4-4bb8-b09b-8eba24435186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:20.259099 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a4971-a2a4-4bb8-b09b-8eba24435186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:20.260555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a4971-a2a4-4bb8-b09b-8eba24435186 service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:20.270943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 478/955] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:22.548616 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04300b5-b021-4bf5-9da7-076f4eeaba81 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:22.549121 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04300b5-b021-4bf5-9da7-076f4eeaba81 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:22.549121 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04300b5-b021-4bf5-9da7-076f4eeaba81 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:22.550406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 478/956] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:22.555778 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1a270-f277-4621-a0eb-65694acd8845 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:22.556200 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1a270-f277-4621-a0eb-65694acd8845 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:22.556283 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1a270-f277-4621-a0eb-65694acd8845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:22.575665 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-26f1a270-f277-4621-a0eb-65694acd8845 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:22.576836 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-26f1a270-f277-4621-a0eb-65694acd8845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:22.585045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 479/957] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:22.626502 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04300b5-b021-4bf5-9da7-076f4eeaba81 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:22.632804 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=65 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:22.639685 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04300b5-b021-4bf5-9da7-076f4eeaba81 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:22.643381 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e09e6e-3f01-4978-ac27-ebd2e21c7540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:22.643982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e09e6e-3f01-4978-ac27-ebd2e21c7540 service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:22.644254 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e09e6e-3f01-4978-ac27-ebd2e21c7540 service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:22.644506 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e09e6e-3f01-4978-ac27-ebd2e21c7540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:22.653620 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e09e6e-3f01-4978-ac27-ebd2e21c7540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:22.655094 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e09e6e-3f01-4978-ac27-ebd2e21c7540 service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:22.664315 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 479/958] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:25.213524 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0281f-049f-4b62-89cd-85ec30fa91d7 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:25.214067 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0281f-049f-4b62-89cd-85ec30fa91d7 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:25.214067 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0281f-049f-4b62-89cd-85ec30fa91d7 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:25.216132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 480/959] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:25.225095 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cb5d8-4167-4339-b87c-ac14dbe5e3d3 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:25.225508 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cb5d8-4167-4339-b87c-ac14dbe5e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:25.225697 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cb5d8-4167-4339-b87c-ac14dbe5e3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:25.246226 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-5f7cb5d8-4167-4339-b87c-ac14dbe5e3d3 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:25.247452 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-5f7cb5d8-4167-4339-b87c-ac14dbe5e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:25.256333 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 480/960] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:25 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:25.295059 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0281f-049f-4b62-89cd-85ec30fa91d7 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:25.314138 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0281f-049f-4b62-89cd-85ec30fa91d7 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:25.320944 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db0471-e294-4753-8e77-616ae0e4f9d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:25.321536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db0471-e294-4753-8e77-616ae0e4f9d5 service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:25.321803 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db0471-e294-4753-8e77-616ae0e4f9d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:25.322059 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db0471-e294-4753-8e77-616ae0e4f9d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:25.332860 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db0471-e294-4753-8e77-616ae0e4f9d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:25.334318 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db0471-e294-4753-8e77-616ae0e4f9d5 service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:25.344600 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 481/961] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:25 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:29.542625 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a877c-cae6-4ea2-9a19-5ff209af6f30 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:29.543176 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a877c-cae6-4ea2-9a19-5ff209af6f30 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:29.543176 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a877c-cae6-4ea2-9a19-5ff209af6f30 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:29.544736 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 481/962] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:29.550175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd01df-b774-48f2-9183-8e91db874007 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:29.550641 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd01df-b774-48f2-9183-8e91db874007 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:29.550734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd01df-b774-48f2-9183-8e91db874007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:29.570349 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-40fd01df-b774-48f2-9183-8e91db874007 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:29.571588 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-40fd01df-b774-48f2-9183-8e91db874007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:29.580432 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 482/963] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:29.620894 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a877c-cae6-4ea2-9a19-5ff209af6f30 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:29.634171 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a877c-cae6-4ea2-9a19-5ff209af6f30 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:29.638048 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d28fe1-24ad-4df3-9786-b962ff48c90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:29.638662 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d28fe1-24ad-4df3-9786-b962ff48c90d service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:29.638936 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d28fe1-24ad-4df3-9786-b962ff48c90d service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:29.639199 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d28fe1-24ad-4df3-9786-b962ff48c90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:29.648028 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d28fe1-24ad-4df3-9786-b962ff48c90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:29.649446 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d28fe1-24ad-4df3-9786-b962ff48c90d service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:29.658620 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 482/964] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:32.596077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c9e70-03e6-4a72-ae89-d52971d24304 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:32.596662 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c9e70-03e6-4a72-ae89-d52971d24304 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:32.596662 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c9e70-03e6-4a72-ae89-d52971d24304 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:32.597933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 483/965] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:32.603508 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579745a0-6298-47b9-8a86-7984e9f9f510 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:32.603961 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579745a0-6298-47b9-8a86-7984e9f9f510 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:32.604080 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579745a0-6298-47b9-8a86-7984e9f9f510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:32.624565 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-579745a0-6298-47b9-8a86-7984e9f9f510 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:32.625797 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-579745a0-6298-47b9-8a86-7984e9f9f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:32.634544 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 483/966] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:32 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:32.672933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c9e70-03e6-4a72-ae89-d52971d24304 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:32.688169 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c9e70-03e6-4a72-ae89-d52971d24304 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:32.691788 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de12c21-7b57-4b29-9464-92d3873c5766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:32.692451 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de12c21-7b57-4b29-9464-92d3873c5766 service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:32.692731 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de12c21-7b57-4b29-9464-92d3873c5766 service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:32.693029 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de12c21-7b57-4b29-9464-92d3873c5766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:32.702549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de12c21-7b57-4b29-9464-92d3873c5766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:32.704009 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de12c21-7b57-4b29-9464-92d3873c5766 service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:32.713403 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 484/967] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:32 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:37.364322 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d3a44-5276-454d-a0c8-8d0afc2a1604 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:37.364829 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d3a44-5276-454d-a0c8-8d0afc2a1604 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:37.364829 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d3a44-5276-454d-a0c8-8d0afc2a1604 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:37.366531 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 484/968] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:37.371935 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95cf35-17eb-47ee-b2d2-cd64947596c9 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:37.372362 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95cf35-17eb-47ee-b2d2-cd64947596c9 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:37.372448 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95cf35-17eb-47ee-b2d2-cd64947596c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:37.379983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=57 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:37.393196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-ac95cf35-17eb-47ee-b2d2-cd64947596c9 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:37.394370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-ac95cf35-17eb-47ee-b2d2-cd64947596c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:37.402572 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 485/969] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:37.441670 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d3a44-5276-454d-a0c8-8d0afc2a1604 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:37.454277 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d3a44-5276-454d-a0c8-8d0afc2a1604 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:37.458467 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165629b-777a-4289-97a9-106e33a10aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:37.459100 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165629b-777a-4289-97a9-106e33a10aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:37.459373 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165629b-777a-4289-97a9-106e33a10aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:37.459640 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165629b-777a-4289-97a9-106e33a10aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:37.469167 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165629b-777a-4289-97a9-106e33a10aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:37.471404 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165629b-777a-4289-97a9-106e33a10aa2 service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:37.481416 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 485/970] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:42.923923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78088c7-985a-4704-ae6a-3cf786e8c6ac None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:42.924440 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78088c7-985a-4704-ae6a-3cf786e8c6ac None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:42.924440 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78088c7-985a-4704-ae6a-3cf786e8c6ac None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:42.925950 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 486/971] 10.222.0.36 () {54 vars in 921 bytes} [Sat Aug 6 20:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:42.937384 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501ea5d-5ff4-4a13-a5e6-3dd55765cad2 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:42.937859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501ea5d-5ff4-4a13-a5e6-3dd55765cad2 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:42.937939 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501ea5d-5ff4-4a13-a5e6-3dd55765cad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:43.008045 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-2501ea5d-5ff4-4a13-a5e6-3dd55765cad2 None None] MFA Rules not processed for user `47953125a0e64fef8f36c17b3504e9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:43.009589 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-2501ea5d-5ff4-4a13-a5e6-3dd55765cad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:43.106074 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 486/972] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Aug 6 20:40:42 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:47.388900 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=2 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:47.418112 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74d57-d202-4ae9-b1e2-c1d4956f0f6f None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:47.418441 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74d57-d202-4ae9-b1e2-c1d4956f0f6f None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:47.418680 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74d57-d202-4ae9-b1e2-c1d4956f0f6f None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:47.420179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 487/973] 10.222.0.36 () {54 vars in 921 bytes} [Sat Aug 6 20:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:47.425038 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1fd0a-a8c2-4413-9797-8a5f91cc32ac None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:47.425538 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1fd0a-a8c2-4413-9797-8a5f91cc32ac None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:47.425856 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1fd0a-a8c2-4413-9797-8a5f91cc32ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:47.445860 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-60b1fd0a-a8c2-4413-9797-8a5f91cc32ac None None] MFA Rules not processed for user `47953125a0e64fef8f36c17b3504e9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:47.447194 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-60b1fd0a-a8c2-4413-9797-8a5f91cc32ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:47.455714 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 487/974] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Aug 6 20:40:47 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:49.104395 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f414f4a-b5e9-48d4-abef-2e5e05224f71 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:49.104979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f414f4a-b5e9-48d4-abef-2e5e05224f71 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:49.104979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f414f4a-b5e9-48d4-abef-2e5e05224f71 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:49.106219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 488/975] 10.222.0.36 () {54 vars in 921 bytes} [Sat Aug 6 20:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:49.111239 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5371a-5813-4fd6-9e5c-31735e232123 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:49.111662 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5371a-5813-4fd6-9e5c-31735e232123 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:49.111778 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5371a-5813-4fd6-9e5c-31735e232123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:49.133547 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-1bc5371a-5813-4fd6-9e5c-31735e232123 None None] MFA Rules not processed for user `47953125a0e64fef8f36c17b3504e9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:49.134780 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-1bc5371a-5813-4fd6-9e5c-31735e232123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:49.143816 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 488/976] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Aug 6 20:40:49 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:53.010206 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ef7a-9c53-4fae-b3e2-bfe6f3263566 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:53.010775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ef7a-9c53-4fae-b3e2-bfe6f3263566 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:53.010775 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ef7a-9c53-4fae-b3e2-bfe6f3263566 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:53.012256 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 489/977] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:53.017754 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262daf1-0ae8-413b-927a-2697830d6971 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:53.018205 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262daf1-0ae8-413b-927a-2697830d6971 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:53.018345 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262daf1-0ae8-413b-927a-2697830d6971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:53.026515 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=69 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:53.040090 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-a262daf1-0ae8-413b-927a-2697830d6971 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:53.041293 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-a262daf1-0ae8-413b-927a-2697830d6971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:53.059950 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 489/978] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:53.109616 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51bcb8-78e9-4748-b5aa-b6eda4a98cbd None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:53.110137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51bcb8-78e9-4748-b5aa-b6eda4a98cbd None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:53.110691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51bcb8-78e9-4748-b5aa-b6eda4a98cbd None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:53.112342 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 490/979] 10.222.0.36 () {54 vars in 962 bytes} [Sat Aug 6 20:40:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:53.121619 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7b33-c697-4a83-82ee-e8d113017624 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:53.122458 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7b33-c697-4a83-82ee-e8d113017624 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:53.123246 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7b33-c697-4a83-82ee-e8d113017624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:53.171468 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-bfeb7b33-c697-4a83-82ee-e8d113017624 None None] MFA Rules not processed for user `9f24d354e53845b2a847fdd12077fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:53.172730 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-bfeb7b33-c697-4a83-82ee-e8d113017624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:53.261134 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 490/980] 10.222.0.36 () {58 vars in 1059 bytes} [Sat Aug 6 20:40:53 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:53.268953 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51bcb8-78e9-4748-b5aa-b6eda4a98cbd None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:53.282760 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51bcb8-78e9-4748-b5aa-b6eda4a98cbd None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:53.288294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503dbfb-7ce2-4d07-a832-00cd4ed83fc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:53.289181 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503dbfb-7ce2-4d07-a832-00cd4ed83fc1 service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:53.289521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503dbfb-7ce2-4d07-a832-00cd4ed83fc1 service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:53.289853 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503dbfb-7ce2-4d07-a832-00cd4ed83fc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:53.298545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503dbfb-7ce2-4d07-a832-00cd4ed83fc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:53.300265 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503dbfb-7ce2-4d07-a832-00cd4ed83fc1 service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:53.310666 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 491/981] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:55.762632 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797711a4-9270-41f8-a8e5-13390ca090d4 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:55.763182 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797711a4-9270-41f8-a8e5-13390ca090d4 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:55.763182 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797711a4-9270-41f8-a8e5-13390ca090d4 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:55.764831 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 491/982] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:55.770022 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d322087-e2a6-4d2e-a564-05079bc3d0f8 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:55.770430 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d322087-e2a6-4d2e-a564-05079bc3d0f8 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:55.770553 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d322087-e2a6-4d2e-a564-05079bc3d0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:55.790947 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-3d322087-e2a6-4d2e-a564-05079bc3d0f8 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:55.792161 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-3d322087-e2a6-4d2e-a564-05079bc3d0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:55.801023 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 492/983] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:55.847773 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797711a4-9270-41f8-a8e5-13390ca090d4 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:55.861630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797711a4-9270-41f8-a8e5-13390ca090d4 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:55.868937 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217432be-89ad-47f9-aaf4-4a0155b7174c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:55.869559 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217432be-89ad-47f9-aaf4-4a0155b7174c service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:55.869830 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217432be-89ad-47f9-aaf4-4a0155b7174c service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:55.870154 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217432be-89ad-47f9-aaf4-4a0155b7174c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:55.879668 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217432be-89ad-47f9-aaf4-4a0155b7174c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:55.881496 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217432be-89ad-47f9-aaf4-4a0155b7174c service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:55.891734 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 492/984] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:58.445009 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa10ccd-b116-4a1e-8757-36184df7775d None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:58.445905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa10ccd-b116-4a1e-8757-36184df7775d None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:58.446184 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa10ccd-b116-4a1e-8757-36184df7775d None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:58.447799 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 493/985] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:58.453422 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488a7b7-f4aa-4356-b122-a70d885ff2e6 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:58.453830 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488a7b7-f4aa-4356-b122-a70d885ff2e6 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:58.454091 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488a7b7-f4aa-4356-b122-a70d885ff2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:58.476264 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-6488a7b7-f4aa-4356-b122-a70d885ff2e6 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:58.476878 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-6488a7b7-f4aa-4356-b122-a70d885ff2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:58.485156 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 493/986] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:58.536688 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89503c2-d783-4650-b3df-a09565f75fcd None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:58.536966 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89503c2-d783-4650-b3df-a09565f75fcd None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:58.537232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89503c2-d783-4650-b3df-a09565f75fcd None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:58.538825 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 494/987] 10.222.0.36 () {54 vars in 962 bytes} [Sat Aug 6 20:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:58.549657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7288b11-1c78-42cb-a44b-110f830df651 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:58.549934 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7288b11-1c78-42cb-a44b-110f830df651 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:58.550208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7288b11-1c78-42cb-a44b-110f830df651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:58.571881 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-b7288b11-1c78-42cb-a44b-110f830df651 None None] MFA Rules not processed for user `9f24d354e53845b2a847fdd12077fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:58.573745 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-b7288b11-1c78-42cb-a44b-110f830df651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:58.584936 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 494/988] 10.222.0.36 () {58 vars in 1059 bytes} [Sat Aug 6 20:40:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:58.594086 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89503c2-d783-4650-b3df-a09565f75fcd None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:58.609499 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89503c2-d783-4650-b3df-a09565f75fcd None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:58.614759 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa90b9f-cd59-45c2-b4c2-df6bae7e164a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:58.615461 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa90b9f-cd59-45c2-b4c2-df6bae7e164a service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:58.615840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa90b9f-cd59-45c2-b4c2-df6bae7e164a service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:58.616077 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa90b9f-cd59-45c2-b4c2-df6bae7e164a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:58.641195 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa90b9f-cd59-45c2-b4c2-df6bae7e164a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:58.643213 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa90b9f-cd59-45c2-b4c2-df6bae7e164a service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:58.661132 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 495/989] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:00.988445 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff9c3d-f346-48f9-a29f-594453dd9592 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:00.989478 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff9c3d-f346-48f9-a29f-594453dd9592 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:00.989954 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff9c3d-f346-48f9-a29f-594453dd9592 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:00.992373 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 495/990] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:41:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:00.998276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1ae27-3709-4ae2-b451-d57570a0e284 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:00.999149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1ae27-3709-4ae2-b451-d57570a0e284 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:00.999671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1ae27-3709-4ae2-b451-d57570a0e284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:01.019923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-87a1ae27-3709-4ae2-b451-d57570a0e284 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:01.021410 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-87a1ae27-3709-4ae2-b451-d57570a0e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:01.038609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 496/991] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:41:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:01.077803 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff9c3d-f346-48f9-a29f-594453dd9592 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:01.093360 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff9c3d-f346-48f9-a29f-594453dd9592 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:01.098919 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014205b4-4cb9-4216-9c31-558fc3d11698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:01.099875 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014205b4-4cb9-4216-9c31-558fc3d11698 service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:01.100545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014205b4-4cb9-4216-9c31-558fc3d11698 service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:01.101087 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014205b4-4cb9-4216-9c31-558fc3d11698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:01.110553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014205b4-4cb9-4216-9c31-558fc3d11698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:01.112746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014205b4-4cb9-4216-9c31-558fc3d11698 service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:01.137487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 496/992] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:03.141625 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f8244-bdb8-4ea5-bf05-5a1841440d9d None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:03.142063 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f8244-bdb8-4ea5-bf05-5a1841440d9d None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:03.142313 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f8244-bdb8-4ea5-bf05-5a1841440d9d None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:03.145938 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 497/993] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:03.151117 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d81a90-1163-4ee8-b433-444bfe9f957f None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:03.151497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d81a90-1163-4ee8-b433-444bfe9f957f None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:03.151721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d81a90-1163-4ee8-b433-444bfe9f957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:03.173507 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-97d81a90-1163-4ee8-b433-444bfe9f957f None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:03.175007 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-97d81a90-1163-4ee8-b433-444bfe9f957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:03.203687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 497/994] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:41:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:03.504856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215f1bb-fefd-4fd1-bf63-8bcb813e0926 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:03.504856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215f1bb-fefd-4fd1-bf63-8bcb813e0926 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:03.504856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215f1bb-fefd-4fd1-bf63-8bcb813e0926 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:03.506007 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 498/995] 10.222.0.36 () {54 vars in 964 bytes} [Sat Aug 6 20:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:41:03.511447 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9d3d5-45ef-4357-8b99-07c87bab11e7 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:03.511725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9d3d5-45ef-4357-8b99-07c87bab11e7 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:03.511990 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9d3d5-45ef-4357-8b99-07c87bab11e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:03.555029 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-d4d9d3d5-45ef-4357-8b99-07c87bab11e7 None None] MFA Rules not processed for user `df2a0a27fb2b48d0b5210f0263639e47`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:03.556265 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-d4d9d3d5-45ef-4357-8b99-07c87bab11e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:03.563107 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595de237-935a-4af8-b993-bc9f776a0d41 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:03.563387 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595de237-935a-4af8-b993-bc9f776a0d41 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:03.563840 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595de237-935a-4af8-b993-bc9f776a0d41 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:03.565344 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 499/996] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:41:03.571947 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb9e8-7d4b-4ab5-a5ff-371c78e61799 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:03.572280 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb9e8-7d4b-4ab5-a5ff-371c78e61799 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:03.572640 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb9e8-7d4b-4ab5-a5ff-371c78e61799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:03.595026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-956fb9e8-7d4b-4ab5-a5ff-371c78e61799 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:03.596590 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-956fb9e8-7d4b-4ab5-a5ff-371c78e61799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:03.604917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 500/997] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:41:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:41:03.626799 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 498/998] 10.222.0.36 () {58 vars in 1061 bytes} [Sat Aug 6 20:41:03 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:03.629732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fb9e8-7d4b-4ab5-a5ff-371c78e61799 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:03.642770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fb9e8-7d4b-4ab5-a5ff-371c78e61799 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:03.643814 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ca327-c4c5-4355-a437-44136f1784ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df2a0a27fb2b48d0b5210f0263639e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:03.644422 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ca327-c4c5-4355-a437-44136f1784ee service cinder] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:03.644691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ca327-c4c5-4355-a437-44136f1784ee service cinder] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:03.645120 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ca327-c4c5-4355-a437-44136f1784ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:03.651733 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9d3d5-45ef-4357-8b99-07c87bab11e7 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:03.655493 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ca327-c4c5-4355-a437-44136f1784ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:03.657551 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ca327-c4c5-4355-a437-44136f1784ee service cinder] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:03.663544 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9d3d5-45ef-4357-8b99-07c87bab11e7 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:03.667498 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 501/999] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:03.668956 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d923d33-b3d5-4016-a40a-9a303de6967f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:03.669566 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d923d33-b3d5-4016-a40a-9a303de6967f service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:03.669841 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d923d33-b3d5-4016-a40a-9a303de6967f service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:03.670112 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d923d33-b3d5-4016-a40a-9a303de6967f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:03.678770 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d923d33-b3d5-4016-a40a-9a303de6967f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:03.680354 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d923d33-b3d5-4016-a40a-9a303de6967f service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:03.684410 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:03.691158 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 499/1000] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:05.958131 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a3dfe-9e42-44aa-8908-814d0cb5900b None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:05.958657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a3dfe-9e42-44aa-8908-814d0cb5900b None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:05.958743 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a3dfe-9e42-44aa-8908-814d0cb5900b None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:05.960334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 502/1001] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:05.966253 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80e795-3ed6-4a9c-9622-dccf240cea58 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:05.966757 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80e795-3ed6-4a9c-9622-dccf240cea58 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:05.966837 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80e795-3ed6-4a9c-9622-dccf240cea58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:05.988989 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-2b80e795-3ed6-4a9c-9622-dccf240cea58 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:05.990381 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-2b80e795-3ed6-4a9c-9622-dccf240cea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:05.999226 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 500/1002] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:41:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:06.045189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a3dfe-9e42-44aa-8908-814d0cb5900b None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:06.058928 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a3dfe-9e42-44aa-8908-814d0cb5900b None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:06.064134 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fb56b-07a3-47a7-8c9a-382493f96fe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:06.064747 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fb56b-07a3-47a7-8c9a-382493f96fe6 service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:06.065017 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fb56b-07a3-47a7-8c9a-382493f96fe6 service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:06.065281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fb56b-07a3-47a7-8c9a-382493f96fe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:06.074321 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fb56b-07a3-47a7-8c9a-382493f96fe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:06.076057 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fb56b-07a3-47a7-8c9a-382493f96fe6 service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:06.086872 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 503/1003] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:41:08.398970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f19297-f978-4b6c-b286-d8baa14e48fa None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:08.399539 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f19297-f978-4b6c-b286-d8baa14e48fa None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:08.399539 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f19297-f978-4b6c-b286-d8baa14e48fa None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:08.401256 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 501/1004] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:08.406950 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4456df8-29a1-49bb-9394-22fe239e51ac None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:08.407401 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4456df8-29a1-49bb-9394-22fe239e51ac None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:08.407482 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4456df8-29a1-49bb-9394-22fe239e51ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:08.427473 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-a4456df8-29a1-49bb-9394-22fe239e51ac None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:08.428764 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-a4456df8-29a1-49bb-9394-22fe239e51ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:08.437575 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 504/1005] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:41:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:08.485553 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f19297-f978-4b6c-b286-d8baa14e48fa None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:08.505426 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f19297-f978-4b6c-b286-d8baa14e48fa None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:08.511884 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac1239-d670-4814-8996-03c7ca123e46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:08.512575 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac1239-d670-4814-8996-03c7ca123e46 service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:08.512919 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac1239-d670-4814-8996-03c7ca123e46 service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:08.513258 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac1239-d670-4814-8996-03c7ca123e46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:08.522784 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac1239-d670-4814-8996-03c7ca123e46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:08.524473 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac1239-d670-4814-8996-03c7ca123e46 service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:08.534438 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 502/1006] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:10.774746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d90fcd-f10c-4f63-9b14-1e3bf5ebb326 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:10.775312 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d90fcd-f10c-4f63-9b14-1e3bf5ebb326 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:10.775312 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d90fcd-f10c-4f63-9b14-1e3bf5ebb326 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:10.776573 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 505/1007] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:10.782029 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c33e0-e2d4-411b-b1b7-71afb8a17607 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:10.782535 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c33e0-e2d4-411b-b1b7-71afb8a17607 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:10.782535 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c33e0-e2d4-411b-b1b7-71afb8a17607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:10.803982 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-743c33e0-e2d4-411b-b1b7-71afb8a17607 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:10.805185 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-743c33e0-e2d4-411b-b1b7-71afb8a17607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:10.815165 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 503/1008] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:41:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:10.861038 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d90fcd-f10c-4f63-9b14-1e3bf5ebb326 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:10.877067 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d90fcd-f10c-4f63-9b14-1e3bf5ebb326 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:10.883927 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694969c5-870d-4754-bcdd-560abc96a08e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:10.884741 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694969c5-870d-4754-bcdd-560abc96a08e service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:10.885158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694969c5-870d-4754-bcdd-560abc96a08e service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:10.885608 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694969c5-870d-4754-bcdd-560abc96a08e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:10.895575 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694969c5-870d-4754-bcdd-560abc96a08e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:10.897363 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694969c5-870d-4754-bcdd-560abc96a08e service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:10.908103 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 506/1009] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:13.294683 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb1a36-4c70-44de-899f-caa91acc6c09 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:13.295668 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb1a36-4c70-44de-899f-caa91acc6c09 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:13.295668 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb1a36-4c70-44de-899f-caa91acc6c09 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:13.296556 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 504/1010] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:41:13.302073 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b60413-6859-4f0b-bfa2-9048bd26788b None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:13.302515 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b60413-6859-4f0b-bfa2-9048bd26788b None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:13.302658 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b60413-6859-4f0b-bfa2-9048bd26788b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:13.321796 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-f4b60413-6859-4f0b-bfa2-9048bd26788b None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:13.323015 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-f4b60413-6859-4f0b-bfa2-9048bd26788b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:13.330599 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 507/1011] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:41:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:13.376739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb1a36-4c70-44de-899f-caa91acc6c09 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:13.391023 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb1a36-4c70-44de-899f-caa91acc6c09 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:13.396808 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b10e93-1410-46f1-b5db-e7aa8ad5b1c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:13.397420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10e93-1410-46f1-b5db-e7aa8ad5b1c9 service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:13.397695 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10e93-1410-46f1-b5db-e7aa8ad5b1c9 service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:13.397960 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10e93-1410-46f1-b5db-e7aa8ad5b1c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:13.409144 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b10e93-1410-46f1-b5db-e7aa8ad5b1c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:13.412335 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b10e93-1410-46f1-b5db-e7aa8ad5b1c9 service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:13.428297 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 505/1012] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:16.242438 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5c8ec-3b7f-46f1-99be-b14c3b17b367 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:16.243172 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5c8ec-3b7f-46f1-99be-b14c3b17b367 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:16.243172 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5c8ec-3b7f-46f1-99be-b14c3b17b367 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:16.244420 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 508/1013] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:16.250347 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a947ff-55a7-4cf5-aeaf-bd6bda9c6505 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:16.250853 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a947ff-55a7-4cf5-aeaf-bd6bda9c6505 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:16.250968 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a947ff-55a7-4cf5-aeaf-bd6bda9c6505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:16.272190 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-47a947ff-55a7-4cf5-aeaf-bd6bda9c6505 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:16.274188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-47a947ff-55a7-4cf5-aeaf-bd6bda9c6505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:16.283701 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 506/1014] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:41:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:16.338276 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5c8ec-3b7f-46f1-99be-b14c3b17b367 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:16.354888 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5c8ec-3b7f-46f1-99be-b14c3b17b367 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:16.360114 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571b80f-f506-401b-8adb-135d64f494c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:16.360719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571b80f-f506-401b-8adb-135d64f494c0 service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:16.360988 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571b80f-f506-401b-8adb-135d64f494c0 service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:16.361254 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571b80f-f506-401b-8adb-135d64f494c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:16.370354 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571b80f-f506-401b-8adb-135d64f494c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:16.371980 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571b80f-f506-401b-8adb-135d64f494c0 service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:16.382613 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 509/1015] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:19.267628 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaeb02-e6f7-4de7-9637-3334a6cf59fc None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:19.268374 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaeb02-e6f7-4de7-9637-3334a6cf59fc None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:19.268374 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaeb02-e6f7-4de7-9637-3334a6cf59fc None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:19.269519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 507/1016] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:19.274917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7670c6c-aeaa-4955-acc6-2308c2c7c732 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:19.275406 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7670c6c-aeaa-4955-acc6-2308c2c7c732 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:19.275406 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7670c6c-aeaa-4955-acc6-2308c2c7c732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:19.282974 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=52 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:19.295876 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-a7670c6c-aeaa-4955-acc6-2308c2c7c732 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:19.297046 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-a7670c6c-aeaa-4955-acc6-2308c2c7c732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:19.306071 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 510/1017] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:41:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:19.352507 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eaeb02-e6f7-4de7-9637-3334a6cf59fc None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:19.366701 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eaeb02-e6f7-4de7-9637-3334a6cf59fc None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:19.372047 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033536e-3721-43da-b796-b3639f12d030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:19.372640 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033536e-3721-43da-b796-b3639f12d030 service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:19.372908 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033536e-3721-43da-b796-b3639f12d030 service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:19.373173 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033536e-3721-43da-b796-b3639f12d030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:19.381651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033536e-3721-43da-b796-b3639f12d030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:19.383346 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033536e-3721-43da-b796-b3639f12d030 service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:19.392705 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 508/1018] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:19.478218 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452797b-27e3-40a1-bec8-ba44866d7f2b None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:19.478636 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452797b-27e3-40a1-bec8-ba44866d7f2b None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:19.478816 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452797b-27e3-40a1-bec8-ba44866d7f2b None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:19.480430 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 511/1019] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:19.486255 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e99c8-42aa-4b77-8d86-902cbcfc3714 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:19.486529 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e99c8-42aa-4b77-8d86-902cbcfc3714 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:19.486799 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e99c8-42aa-4b77-8d86-902cbcfc3714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:19.509874 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-507e99c8-42aa-4b77-8d86-902cbcfc3714 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:19.511253 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-507e99c8-42aa-4b77-8d86-902cbcfc3714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:19.519379 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 509/1020] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:41:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:19.580268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24d489-73f6-4e97-962d-be54996fa34b None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:19.580632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24d489-73f6-4e97-962d-be54996fa34b None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:19.580962 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24d489-73f6-4e97-962d-be54996fa34b None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:19.582390 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 512/1021] 10.222.0.36 () {54 vars in 966 bytes} [Sat Aug 6 20:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:19.588099 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7447a-df57-4497-b58d-db5bf62c55a8 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:19.588453 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7447a-df57-4497-b58d-db5bf62c55a8 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:19.588785 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7447a-df57-4497-b58d-db5bf62c55a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:19.633913 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-daf7447a-df57-4497-b58d-db5bf62c55a8 None None] MFA Rules not processed for user `b5c55b636efe4fe483c4905af6ca5115`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:19.635169 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-daf7447a-df57-4497-b58d-db5bf62c55a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:19.696438 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 510/1022] 10.222.0.36 () {58 vars in 1063 bytes} [Sat Aug 6 20:41:19 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:19.703977 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24d489-73f6-4e97-962d-be54996fa34b None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:19.716337 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24d489-73f6-4e97-962d-be54996fa34b None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:19.720449 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebec5a5-f6fa-4378-8087-9c9ee0463d81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55b636efe4fe483c4905af6ca5115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:19.721063 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebec5a5-f6fa-4378-8087-9c9ee0463d81 service glance] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:19.721329 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebec5a5-f6fa-4378-8087-9c9ee0463d81 service glance] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:19.721592 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebec5a5-f6fa-4378-8087-9c9ee0463d81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:19.730849 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebec5a5-f6fa-4378-8087-9c9ee0463d81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:19.732311 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebec5a5-f6fa-4378-8087-9c9ee0463d81 service glance] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:19.741659 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 513/1023] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:21.689301 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5704993-08f9-4db2-b638-b0c3f9c00c0f None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:21.689985 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5704993-08f9-4db2-b638-b0c3f9c00c0f None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:21.689985 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5704993-08f9-4db2-b638-b0c3f9c00c0f None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:21.691308 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 511/1024] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:21.697551 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b4651-a8ec-42be-a41f-781b6ffa4e83 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:21.698058 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b4651-a8ec-42be-a41f-781b6ffa4e83 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:21.698157 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b4651-a8ec-42be-a41f-781b6ffa4e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:21.720502 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-0d0b4651-a8ec-42be-a41f-781b6ffa4e83 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:21.721789 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-0d0b4651-a8ec-42be-a41f-781b6ffa4e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:21.731778 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 514/1025] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:41:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:21.778277 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5704993-08f9-4db2-b638-b0c3f9c00c0f None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:21.795867 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5704993-08f9-4db2-b638-b0c3f9c00c0f None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:21.801400 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68315aa-85f2-40d7-8b2b-1993c46a863d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:21.802079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68315aa-85f2-40d7-8b2b-1993c46a863d service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:21.802422 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68315aa-85f2-40d7-8b2b-1993c46a863d service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:21.803082 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68315aa-85f2-40d7-8b2b-1993c46a863d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:21.812063 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68315aa-85f2-40d7-8b2b-1993c46a863d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:21.813727 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68315aa-85f2-40d7-8b2b-1993c46a863d service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:21.828812 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 512/1026] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:31.715354 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=11 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:31.824617 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=70 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:35.025778 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237b6df-98ac-4b1d-ae94-fe4666d210ba None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:35.026446 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237b6df-98ac-4b1d-ae94-fe4666d210ba None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:35.026446 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237b6df-98ac-4b1d-ae94-fe4666d210ba None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:35.027663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 515/1027] 10.222.0.36 () {54 vars in 918 bytes} [Sat Aug 6 20:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:35.032907 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d4b32-d9d1-49fb-8117-957810a8456e None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:35.033395 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d4b32-d9d1-49fb-8117-957810a8456e None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:35.033501 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d4b32-d9d1-49fb-8117-957810a8456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:35.054620 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-a01d4b32-d9d1-49fb-8117-957810a8456e None None] MFA Rules not processed for user `47953125a0e64fef8f36c17b3504e9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:35.055859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-a01d4b32-d9d1-49fb-8117-957810a8456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:35.065991 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 513/1028] 10.222.0.36 () {58 vars in 1015 bytes} [Sat Aug 6 20:41:35 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:35.080491 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0891266-5b28-472f-a04a-f63785243f4b None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:35.080768 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0891266-5b28-472f-a04a-f63785243f4b None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:35.081034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0891266-5b28-472f-a04a-f63785243f4b None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:35.082340 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 516/1029] 10.222.0.36 () {54 vars in 918 bytes} [Sat Aug 6 20:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:35.086816 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a971d-6729-4961-8c7e-97df982c92d5 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:35.087133 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a971d-6729-4961-8c7e-97df982c92d5 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:35.087402 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a971d-6729-4961-8c7e-97df982c92d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:35.109846 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-c58a971d-6729-4961-8c7e-97df982c92d5 None None] MFA Rules not processed for user `9f24d354e53845b2a847fdd12077fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:35.111079 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-c58a971d-6729-4961-8c7e-97df982c92d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:35.122041 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 514/1030] 10.222.0.36 () {58 vars in 1015 bytes} [Sat Aug 6 20:41:35 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:37.846902 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abbdc7-0aad-4ed0-8159-9f42f34e7798 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:37.847504 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abbdc7-0aad-4ed0-8159-9f42f34e7798 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:37.847504 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abbdc7-0aad-4ed0-8159-9f42f34e7798 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:37.848745 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 517/1031] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:37.854111 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d598fe6-f186-44b7-99a4-28bf1e0d304e None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:37.854562 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d598fe6-f186-44b7-99a4-28bf1e0d304e None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:37.854699 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d598fe6-f186-44b7-99a4-28bf1e0d304e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:37.874869 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-0d598fe6-f186-44b7-99a4-28bf1e0d304e None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:37.876043 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-0d598fe6-f186-44b7-99a4-28bf1e0d304e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:37.884331 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 515/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:41:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:37.928248 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abbdc7-0aad-4ed0-8159-9f42f34e7798 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:37.943020 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abbdc7-0aad-4ed0-8159-9f42f34e7798 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:37.948892 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9f972-9b6b-4db1-8618-544c9f31c02c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:37.949488 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9f972-9b6b-4db1-8618-544c9f31c02c service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:37.949759 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9f972-9b6b-4db1-8618-544c9f31c02c service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:37.950023 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9f972-9b6b-4db1-8618-544c9f31c02c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:37.958849 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9f972-9b6b-4db1-8618-544c9f31c02c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:37.960948 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9f972-9b6b-4db1-8618-544c9f31c02c service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:37.971067 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 518/1033] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:38.910151 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065c1b8-3220-4e0f-a756-c0837b637d72 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:38.910771 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065c1b8-3220-4e0f-a756-c0837b637d72 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:38.910771 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065c1b8-3220-4e0f-a756-c0837b637d72 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:38.912081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 516/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:38.918094 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb83efe-b6f5-46d2-af51-0ac9553b4cc2 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:38.918882 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb83efe-b6f5-46d2-af51-0ac9553b4cc2 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:38.919035 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb83efe-b6f5-46d2-af51-0ac9553b4cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:38.948857 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-3fb83efe-b6f5-46d2-af51-0ac9553b4cc2 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:38.950035 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-3fb83efe-b6f5-46d2-af51-0ac9553b4cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:38.958540 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 519/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:41:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:41:39.188786 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065c1b8-3220-4e0f-a756-c0837b637d72 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:39.211561 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065c1b8-3220-4e0f-a756-c0837b637d72 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:39.216741 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763301b-bf3f-4870-b177-1716098f7168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:39.217341 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763301b-bf3f-4870-b177-1716098f7168 service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:39.217618 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763301b-bf3f-4870-b177-1716098f7168 service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:39.217887 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763301b-bf3f-4870-b177-1716098f7168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:39.226869 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763301b-bf3f-4870-b177-1716098f7168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:39.228467 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763301b-bf3f-4870-b177-1716098f7168 service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:39.237967 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 517/1036] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:40.183979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedd7b0-4ad7-4ef0-b333-969dd55102af None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:40.184529 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedd7b0-4ad7-4ef0-b333-969dd55102af None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:40.184529 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedd7b0-4ad7-4ef0-b333-969dd55102af None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:40.186420 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 520/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:40.194101 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8123176-3eb8-41dd-8145-6a7d2182fc49 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:40.194565 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8123176-3eb8-41dd-8145-6a7d2182fc49 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:40.194789 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8123176-3eb8-41dd-8145-6a7d2182fc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:40.217226 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-d8123176-3eb8-41dd-8145-6a7d2182fc49 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:40.218406 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-d8123176-3eb8-41dd-8145-6a7d2182fc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:40.229456 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 518/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:41:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:40.384492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedd7b0-4ad7-4ef0-b333-969dd55102af None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:40.409238 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedd7b0-4ad7-4ef0-b333-969dd55102af None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:40.416839 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b983c4c-9c63-4b35-ac0c-ba0cde63ff97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:40.417435 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b983c4c-9c63-4b35-ac0c-ba0cde63ff97 service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:40.417707 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b983c4c-9c63-4b35-ac0c-ba0cde63ff97 service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:40.417971 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b983c4c-9c63-4b35-ac0c-ba0cde63ff97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:40.426529 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b983c4c-9c63-4b35-ac0c-ba0cde63ff97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:40.428158 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b983c4c-9c63-4b35-ac0c-ba0cde63ff97 service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:40.438447 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 521/1039] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:41.323155 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec217b8-f61e-43f2-91d3-1c7a9cec1510 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:41.323763 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec217b8-f61e-43f2-91d3-1c7a9cec1510 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:41.323763 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec217b8-f61e-43f2-91d3-1c7a9cec1510 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:41.325327 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 519/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:41.331298 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90d33a-a24c-4689-bea9-722e4eb51d5d None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:41.332030 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90d33a-a24c-4689-bea9-722e4eb51d5d None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:41.332337 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90d33a-a24c-4689-bea9-722e4eb51d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:41.356021 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-3c90d33a-a24c-4689-bea9-722e4eb51d5d None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:41.357212 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-3c90d33a-a24c-4689-bea9-722e4eb51d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:41.367086 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 522/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:41:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:41.524983 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec217b8-f61e-43f2-91d3-1c7a9cec1510 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:41.548865 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec217b8-f61e-43f2-91d3-1c7a9cec1510 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:41.554915 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3f32f-22df-4eda-b0b7-176cea7c09fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:41.555511 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3f32f-22df-4eda-b0b7-176cea7c09fc service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:41.555780 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3f32f-22df-4eda-b0b7-176cea7c09fc service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:41.556047 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3f32f-22df-4eda-b0b7-176cea7c09fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:41.564160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3f32f-22df-4eda-b0b7-176cea7c09fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:41.565738 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3f32f-22df-4eda-b0b7-176cea7c09fc service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:41.576122 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 520/1042] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:42.466943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1cab6-32f8-44b9-a67b-fd5ba865159b None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:42.467512 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1cab6-32f8-44b9-a67b-fd5ba865159b None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:42.467512 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1cab6-32f8-44b9-a67b-fd5ba865159b None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:42.469404 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 523/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:42.477095 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18158a-bb56-4f0a-b8bb-cb83083e86ea None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:42.477519 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18158a-bb56-4f0a-b8bb-cb83083e86ea None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:42.477615 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18158a-bb56-4f0a-b8bb-cb83083e86ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:42.498182 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-de18158a-bb56-4f0a-b8bb-cb83083e86ea None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:42.499405 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-de18158a-bb56-4f0a-b8bb-cb83083e86ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:42.508787 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 521/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:41:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:42.668271 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1cab6-32f8-44b9-a67b-fd5ba865159b None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:42.691408 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1cab6-32f8-44b9-a67b-fd5ba865159b None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:42.698750 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88012ec2-79c2-4ddc-b3e0-3eca0d306a02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:42.699341 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88012ec2-79c2-4ddc-b3e0-3eca0d306a02 service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:42.699608 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88012ec2-79c2-4ddc-b3e0-3eca0d306a02 service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:42.699873 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88012ec2-79c2-4ddc-b3e0-3eca0d306a02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:42.708747 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88012ec2-79c2-4ddc-b3e0-3eca0d306a02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:42.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88012ec2-79c2-4ddc-b3e0-3eca0d306a02 service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:42.720516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 524/1045] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:43.523849 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acb97e-d576-41a4-bc9f-51fd5ad197ca None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:43.524393 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acb97e-d576-41a4-bc9f-51fd5ad197ca None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:43.524393 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acb97e-d576-41a4-bc9f-51fd5ad197ca None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:43.525722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 522/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:43.531807 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39ae6e-3fba-4f65-984d-7cbe9a27d255 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:43.532575 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39ae6e-3fba-4f65-984d-7cbe9a27d255 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:43.532575 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39ae6e-3fba-4f65-984d-7cbe9a27d255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:43.561387 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-0e39ae6e-3fba-4f65-984d-7cbe9a27d255 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:43.562570 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-0e39ae6e-3fba-4f65-984d-7cbe9a27d255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:43.571582 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 525/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:41:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:43.740492 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acb97e-d576-41a4-bc9f-51fd5ad197ca None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:43.762141 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acb97e-d576-41a4-bc9f-51fd5ad197ca None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:43.771932 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9556b-b362-4d77-9ee7-0c285a3f8274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:43.772699 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9556b-b362-4d77-9ee7-0c285a3f8274 service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:43.772969 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9556b-b362-4d77-9ee7-0c285a3f8274 service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:43.773232 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9556b-b362-4d77-9ee7-0c285a3f8274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:43.781649 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9556b-b362-4d77-9ee7-0c285a3f8274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:43.783628 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9556b-b362-4d77-9ee7-0c285a3f8274 service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:43.793857 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 523/1048] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:44.622974 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af5f36-d228-491c-becc-5fffa583fde0 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:44.623508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af5f36-d228-491c-becc-5fffa583fde0 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:44.623508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af5f36-d228-491c-becc-5fffa583fde0 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:44.624872 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 526/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:44.630171 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda37d12-47a2-4bee-8803-7be95d09d46e None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:44.630607 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda37d12-47a2-4bee-8803-7be95d09d46e None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:44.630754 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda37d12-47a2-4bee-8803-7be95d09d46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:44.649970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-eda37d12-47a2-4bee-8803-7be95d09d46e None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:44.651219 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-eda37d12-47a2-4bee-8803-7be95d09d46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:44.659094 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 524/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:41:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:44.828543 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af5f36-d228-491c-becc-5fffa583fde0 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:44.852104 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af5f36-d228-491c-becc-5fffa583fde0 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:44.858361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4763d-e434-4bb1-be06-a0e1aa19967f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:44.859045 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4763d-e434-4bb1-be06-a0e1aa19967f service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:44.859219 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4763d-e434-4bb1-be06-a0e1aa19967f service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:44.859504 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4763d-e434-4bb1-be06-a0e1aa19967f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:44.868545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4763d-e434-4bb1-be06-a0e1aa19967f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:44.870130 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4763d-e434-4bb1-be06-a0e1aa19967f service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:44.879533 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 527/1051] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:45.705286 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ed04-4986-47f3-8b4b-13a58be972fd None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:45.706221 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ed04-4986-47f3-8b4b-13a58be972fd None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:45.706221 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ed04-4986-47f3-8b4b-13a58be972fd None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:45.708349 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 525/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:41:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:45.714389 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51a229-5a6e-41bb-9c27-3ff15d56a143 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:45.715156 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51a229-5a6e-41bb-9c27-3ff15d56a143 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:45.715365 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51a229-5a6e-41bb-9c27-3ff15d56a143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:45.739940 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-ec51a229-5a6e-41bb-9c27-3ff15d56a143 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:45.741576 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-ec51a229-5a6e-41bb-9c27-3ff15d56a143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:45.750155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 528/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:41:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:45.911717 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0ed04-4986-47f3-8b4b-13a58be972fd None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:45.932806 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0ed04-4986-47f3-8b4b-13a58be972fd None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:45.938198 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957d237-2ed6-445e-a758-1132df084b32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:45.938850 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957d237-2ed6-445e-a758-1132df084b32 service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:45.939123 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957d237-2ed6-445e-a758-1132df084b32 service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:45.939395 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957d237-2ed6-445e-a758-1132df084b32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:45.947873 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957d237-2ed6-445e-a758-1132df084b32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:45.949439 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957d237-2ed6-445e-a758-1132df084b32 service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:45.958760 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 526/1054] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:46.786277 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24761d5-a79a-4e61-a818-ed6c42f036fd None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:46.787209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24761d5-a79a-4e61-a818-ed6c42f036fd None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:46.787209 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24761d5-a79a-4e61-a818-ed6c42f036fd None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:46.789233 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 529/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:41:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:46.795021 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ab936-5fcf-4739-8dde-a767e5954fa9 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:46.795459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ab936-5fcf-4739-8dde-a767e5954fa9 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:46.795579 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ab936-5fcf-4739-8dde-a767e5954fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:46.819072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-227ab936-5fcf-4739-8dde-a767e5954fa9 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:46.820240 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-227ab936-5fcf-4739-8dde-a767e5954fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:46.829736 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 527/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:41:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:46.988294 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24761d5-a79a-4e61-a818-ed6c42f036fd None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:47.010513 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24761d5-a79a-4e61-a818-ed6c42f036fd None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:47.016587 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb6af7-c8ec-4659-938e-02ad3f7e899d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:47.017185 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb6af7-c8ec-4659-938e-02ad3f7e899d service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:47.017463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb6af7-c8ec-4659-938e-02ad3f7e899d service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:47.017736 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb6af7-c8ec-4659-938e-02ad3f7e899d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:47.025966 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb6af7-c8ec-4659-938e-02ad3f7e899d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:47.027589 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb6af7-c8ec-4659-938e-02ad3f7e899d service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:47.037029 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 530/1057] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:49.134255 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433c1dd-6f1f-4d10-9cea-c8487e14a023 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:49.134883 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433c1dd-6f1f-4d10-9cea-c8487e14a023 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:49.134883 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433c1dd-6f1f-4d10-9cea-c8487e14a023 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:49.136673 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 528/1058] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:41:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:49.144977 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f2981-4260-4ca4-a909-b3817b440065 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:49.145431 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f2981-4260-4ca4-a909-b3817b440065 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:49.145524 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f2981-4260-4ca4-a909-b3817b440065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:49.169241 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-d69f2981-4260-4ca4-a909-b3817b440065 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:49.170447 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-d69f2981-4260-4ca4-a909-b3817b440065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:49.179970 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 531/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:41:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:41:49.219640 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433c1dd-6f1f-4d10-9cea-c8487e14a023 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:49.233175 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433c1dd-6f1f-4d10-9cea-c8487e14a023 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:49.237355 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f38d13-fa96-4a6e-957a-04cef318ebb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:49.237958 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f38d13-fa96-4a6e-957a-04cef318ebb2 service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:49.238231 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f38d13-fa96-4a6e-957a-04cef318ebb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:49.238499 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f38d13-fa96-4a6e-957a-04cef318ebb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:49.248453 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f38d13-fa96-4a6e-957a-04cef318ebb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:49.249915 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f38d13-fa96-4a6e-957a-04cef318ebb2 service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:49.259346 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 529/1060] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:51.659663 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5dd39-4861-43e4-8548-240b7dd102cd None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:51.660224 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5dd39-4861-43e4-8548-240b7dd102cd None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:51.660224 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5dd39-4861-43e4-8548-240b7dd102cd None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:51.661526 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 532/1061] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:51.668130 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d26411-e2cc-43dc-9abc-a7674a475944 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:51.668566 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d26411-e2cc-43dc-9abc-a7674a475944 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:51.668707 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d26411-e2cc-43dc-9abc-a7674a475944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:51.698509 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-b5d26411-e2cc-43dc-9abc-a7674a475944 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:51.699741 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-b5d26411-e2cc-43dc-9abc-a7674a475944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:51.709098 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 530/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:41:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:51.753432 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5dd39-4861-43e4-8548-240b7dd102cd None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:51.766349 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5dd39-4861-43e4-8548-240b7dd102cd None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:51.770688 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a042922-3946-471a-a989-4b59defecbd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:51.771281 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a042922-3946-471a-a989-4b59defecbd5 service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:51.771555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a042922-3946-471a-a989-4b59defecbd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:51.771850 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a042922-3946-471a-a989-4b59defecbd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:51.782563 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a042922-3946-471a-a989-4b59defecbd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:51.784033 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a042922-3946-471a-a989-4b59defecbd5 service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:51.797203 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 533/1063] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:54.380185 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb1e17-525b-49cf-a626-2d739c4c6154 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:54.381093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb1e17-525b-49cf-a626-2d739c4c6154 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:54.381093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb1e17-525b-49cf-a626-2d739c4c6154 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:54.383084 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 531/1064] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:41:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:54.388662 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dccf8-0049-4225-bf04-d9db4d1d3f3e None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:54.389149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dccf8-0049-4225-bf04-d9db4d1d3f3e None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:54.389149 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dccf8-0049-4225-bf04-d9db4d1d3f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:54.409946 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-166dccf8-0049-4225-bf04-d9db4d1d3f3e None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:54.411148 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-166dccf8-0049-4225-bf04-d9db4d1d3f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:54.419664 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 534/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:41:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:54.467411 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb1e17-525b-49cf-a626-2d739c4c6154 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:54.480031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb1e17-525b-49cf-a626-2d739c4c6154 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:54.484189 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908cf32-2807-40e0-9622-1c25fc16adba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:54.484816 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908cf32-2807-40e0-9622-1c25fc16adba service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:54.485089 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908cf32-2807-40e0-9622-1c25fc16adba service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:54.485382 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908cf32-2807-40e0-9622-1c25fc16adba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:54.494732 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908cf32-2807-40e0-9622-1c25fc16adba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:54.496160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908cf32-2807-40e0-9622-1c25fc16adba service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:54.505506 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 532/1066] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:56.836838 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89334a44-0bf3-4b6b-abb3-d930d5ab5dc8 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:56.837424 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89334a44-0bf3-4b6b-abb3-d930d5ab5dc8 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:56.837424 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89334a44-0bf3-4b6b-abb3-d930d5ab5dc8 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:56.839532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 535/1067] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:41:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:56.848505 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f67dd-6549-4c30-bb10-6a5e10587b41 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:56.848923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f67dd-6549-4c30-bb10-6a5e10587b41 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:56.849064 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f67dd-6549-4c30-bb10-6a5e10587b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:56.870005 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-b08f67dd-6549-4c30-bb10-6a5e10587b41 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:56.871223 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-b08f67dd-6549-4c30-bb10-6a5e10587b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:56.880921 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 533/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:41:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:56.924608 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89334a44-0bf3-4b6b-abb3-d930d5ab5dc8 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:56.944457 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89334a44-0bf3-4b6b-abb3-d930d5ab5dc8 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:56.948865 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ac9b5-3936-4134-9577-bf855d6a2a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:56.949465 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ac9b5-3936-4134-9577-bf855d6a2a75 service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:56.949734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ac9b5-3936-4134-9577-bf855d6a2a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:56.949998 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ac9b5-3936-4134-9577-bf855d6a2a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:56.959691 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ac9b5-3936-4134-9577-bf855d6a2a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:56.960988 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ac9b5-3936-4134-9577-bf855d6a2a75 service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:56.970713 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 536/1069] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:41:59.308415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91f0c0-bd7c-4bc6-bc6b-9bda6ed36984 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:59.308950 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91f0c0-bd7c-4bc6-bc6b-9bda6ed36984 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:59.308950 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91f0c0-bd7c-4bc6-bc6b-9bda6ed36984 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:59.310191 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 534/1070] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:59.316707 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5652727-9983-4514-9e7e-dc59bc239adc None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:59.317389 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5652727-9983-4514-9e7e-dc59bc239adc None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:59.317551 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5652727-9983-4514-9e7e-dc59bc239adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:59.344532 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-d5652727-9983-4514-9e7e-dc59bc239adc None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:59.346069 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-d5652727-9983-4514-9e7e-dc59bc239adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:59.354564 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 537/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:41:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:59.393926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91f0c0-bd7c-4bc6-bc6b-9bda6ed36984 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:59.407352 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91f0c0-bd7c-4bc6-bc6b-9bda6ed36984 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:59.412099 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af691583-8393-44d3-9b51-69d8a022a803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:59.412702 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af691583-8393-44d3-9b51-69d8a022a803 service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:59.412978 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af691583-8393-44d3-9b51-69d8a022a803 service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:59.413243 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af691583-8393-44d3-9b51-69d8a022a803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:59.427561 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af691583-8393-44d3-9b51-69d8a022a803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:59.429402 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af691583-8393-44d3-9b51-69d8a022a803 service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:59.438873 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 535/1072] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:41:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:01.707235 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c088058-bf8c-4e7b-9d00-ef141518c735 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:01.708134 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c088058-bf8c-4e7b-9d00-ef141518c735 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:01.708134 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c088058-bf8c-4e7b-9d00-ef141518c735 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:01.710009 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 538/1073] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:42:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:01.715708 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cd6e7-3e36-4c20-96ab-283609fcd2df None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:01.716217 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cd6e7-3e36-4c20-96ab-283609fcd2df None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:01.716217 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cd6e7-3e36-4c20-96ab-283609fcd2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:01.738137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-ba8cd6e7-3e36-4c20-96ab-283609fcd2df None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:01.739364 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-ba8cd6e7-3e36-4c20-96ab-283609fcd2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:01.747664 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 536/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:42:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:42:01.790244 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c088058-bf8c-4e7b-9d00-ef141518c735 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:01.796746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=64 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:01.805179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c088058-bf8c-4e7b-9d00-ef141518c735 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:01.809028 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c7cda-7f0d-419e-a491-1732ac79483b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:01.809662 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7cda-7f0d-419e-a491-1732ac79483b service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:01.809935 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7cda-7f0d-419e-a491-1732ac79483b service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:01.810200 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7cda-7f0d-419e-a491-1732ac79483b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:01.819502 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c7cda-7f0d-419e-a491-1732ac79483b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:01.820954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c7cda-7f0d-419e-a491-1732ac79483b service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:01.830521 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 539/1075] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:04.097150 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d5ce6-b2f4-46e1-94ec-b6787560c4ee None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:04.097701 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d5ce6-b2f4-46e1-94ec-b6787560c4ee None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:04.097701 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d5ce6-b2f4-46e1-94ec-b6787560c4ee None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:04.100052 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 537/1076] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:42:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:04.109268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b35052-5513-4417-9131-1103b5e63120 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:04.109979 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b35052-5513-4417-9131-1103b5e63120 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:04.110135 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b35052-5513-4417-9131-1103b5e63120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:04.133534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-19b35052-5513-4417-9131-1103b5e63120 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:04.134767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-19b35052-5513-4417-9131-1103b5e63120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:04.143225 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 540/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:42:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:04.185391 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d5ce6-b2f4-46e1-94ec-b6787560c4ee None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:04.195081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=73 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:04.202547 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d5ce6-b2f4-46e1-94ec-b6787560c4ee None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:04.207193 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dbac9-bf4d-4a95-8911-fcf3ae4cbc25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:04.207799 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dbac9-bf4d-4a95-8911-fcf3ae4cbc25 service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:04.208071 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dbac9-bf4d-4a95-8911-fcf3ae4cbc25 service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:04.208341 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dbac9-bf4d-4a95-8911-fcf3ae4cbc25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:04.218604 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dbac9-bf4d-4a95-8911-fcf3ae4cbc25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:04.220051 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dbac9-bf4d-4a95-8911-fcf3ae4cbc25 service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:04.230170 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 538/1078] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:06.502463 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53311122-95c1-4ff8-8d49-990c80db4fc4 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:06.503094 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53311122-95c1-4ff8-8d49-990c80db4fc4 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:06.503094 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53311122-95c1-4ff8-8d49-990c80db4fc4 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:06.504346 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 541/1079] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:06.510640 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13815-38dd-42a7-8402-87e2c791656f None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:06.511088 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13815-38dd-42a7-8402-87e2c791656f None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:06.511186 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13815-38dd-42a7-8402-87e2c791656f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:06.541278 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-d4c13815-38dd-42a7-8402-87e2c791656f None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:06.542479 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-d4c13815-38dd-42a7-8402-87e2c791656f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:06.550663 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 539/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:42:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:06.589913 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53311122-95c1-4ff8-8d49-990c80db4fc4 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:06.602296 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53311122-95c1-4ff8-8d49-990c80db4fc4 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:06.606821 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e020daa-91df-492e-80e4-5b40e7691d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:06.607408 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e020daa-91df-492e-80e4-5b40e7691d77 service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:06.607674 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e020daa-91df-492e-80e4-5b40e7691d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:06.607933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e020daa-91df-492e-80e4-5b40e7691d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:06.617961 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e020daa-91df-492e-80e4-5b40e7691d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:06.619428 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e020daa-91df-492e-80e4-5b40e7691d77 service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:06.629026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 542/1081] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:08.885923 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0ae66-0512-45bc-98e3-3466da70175e None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:08.886906 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0ae66-0512-45bc-98e3-3466da70175e None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:08.886906 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0ae66-0512-45bc-98e3-3466da70175e None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:08.888946 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 540/1082] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:42:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:08.895392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f7a65-1bbb-4cc5-98e3-7e33e4b26482 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:08.896147 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f7a65-1bbb-4cc5-98e3-7e33e4b26482 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:08.896295 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f7a65-1bbb-4cc5-98e3-7e33e4b26482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:08.922958 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-a99f7a65-1bbb-4cc5-98e3-7e33e4b26482 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:08.924146 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-a99f7a65-1bbb-4cc5-98e3-7e33e4b26482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:08.931975 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 543/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:42:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:08.970048 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0ae66-0512-45bc-98e3-3466da70175e None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:08.982992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0ae66-0512-45bc-98e3-3466da70175e None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:08.987451 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598b48a-5fbb-47c5-b1b6-ef63c02cbcad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:08.988051 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598b48a-5fbb-47c5-b1b6-ef63c02cbcad service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:08.988354 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598b48a-5fbb-47c5-b1b6-ef63c02cbcad service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:08.988612 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598b48a-5fbb-47c5-b1b6-ef63c02cbcad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:08.997804 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598b48a-5fbb-47c5-b1b6-ef63c02cbcad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:08.999268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598b48a-5fbb-47c5-b1b6-ef63c02cbcad service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:09.008744 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 541/1084] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:11.244074 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f52fb-6999-4590-98e8-72170fce037a None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:11.244681 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f52fb-6999-4590-98e8-72170fce037a None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:11.244681 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f52fb-6999-4590-98e8-72170fce037a None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:11.245940 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 544/1085] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:11.251494 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347536d7-4821-4d1c-9499-ad93b03cd706 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:11.251930 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347536d7-4821-4d1c-9499-ad93b03cd706 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:11.252023 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347536d7-4821-4d1c-9499-ad93b03cd706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:11.278358 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-347536d7-4821-4d1c-9499-ad93b03cd706 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:11.279631 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-347536d7-4821-4d1c-9499-ad93b03cd706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:11.288640 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 542/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:42:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:11.326203 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f52fb-6999-4590-98e8-72170fce037a None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:11.337834 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f52fb-6999-4590-98e8-72170fce037a None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:11.341954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d2775-988f-47a0-8e1e-1b194907e777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:11.342544 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d2775-988f-47a0-8e1e-1b194907e777 service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:11.342847 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d2775-988f-47a0-8e1e-1b194907e777 service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:11.343121 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d2775-988f-47a0-8e1e-1b194907e777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:11.352827 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d2775-988f-47a0-8e1e-1b194907e777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:11.354260 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d2775-988f-47a0-8e1e-1b194907e777 service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:11.364025 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 545/1087] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:42:21.273115 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=17 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:21.359398 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=23 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:34.994309 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35375eeb-4b9e-465c-877b-46ce86837275 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:34.994960 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35375eeb-4b9e-465c-877b-46ce86837275 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:34.994960 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35375eeb-4b9e-465c-877b-46ce86837275 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:34.996219 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 543/1088] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:35.001661 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135dbef-60b0-4009-994f-8267fc1427cf None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:35.002085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135dbef-60b0-4009-994f-8267fc1427cf None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:35.002196 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135dbef-60b0-4009-994f-8267fc1427cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:35.023283 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-3135dbef-60b0-4009-994f-8267fc1427cf None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:35.024460 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-3135dbef-60b0-4009-994f-8267fc1427cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:35.033995 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 546/1089] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:42:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:35.089072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e275bb-ed39-4a80-bc43-b42d8ca4d700 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:35.089479 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e275bb-ed39-4a80-bc43-b42d8ca4d700 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:35.089867 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e275bb-ed39-4a80-bc43-b42d8ca4d700 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:35.091974 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 544/1090] 10.222.0.36 () {54 vars in 966 bytes} [Sat Aug 6 20:42:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:35.101512 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e86d15-e671-482f-affd-0e711bf6d511 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:35.101848 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e86d15-e671-482f-affd-0e711bf6d511 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:35.102087 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e86d15-e671-482f-affd-0e711bf6d511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:35.123212 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-e1e86d15-e671-482f-affd-0e711bf6d511 None None] MFA Rules not processed for user `b5c55b636efe4fe483c4905af6ca5115`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:35.124424 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-e1e86d15-e671-482f-affd-0e711bf6d511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:35.131850 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 547/1091] 10.222.0.36 () {58 vars in 1063 bytes} [Sat Aug 6 20:42:35 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:35.141277 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e275bb-ed39-4a80-bc43-b42d8ca4d700 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:35.157830 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e275bb-ed39-4a80-bc43-b42d8ca4d700 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:35.162961 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf779be7-172f-4b81-a4c0-f99385e16cfd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55b636efe4fe483c4905af6ca5115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:35.163685 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf779be7-172f-4b81-a4c0-f99385e16cfd service glance] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:35.163958 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf779be7-172f-4b81-a4c0-f99385e16cfd service glance] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:35.164246 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf779be7-172f-4b81-a4c0-f99385e16cfd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:35.174574 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf779be7-172f-4b81-a4c0-f99385e16cfd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:35.176034 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf779be7-172f-4b81-a4c0-f99385e16cfd service glance] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:35.186308 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 545/1092] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:42:37.497949 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6bc12-45d2-417f-8a07-2700aedd301c None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:37.498495 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6bc12-45d2-417f-8a07-2700aedd301c None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:37.498495 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6bc12-45d2-417f-8a07-2700aedd301c None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:37.499856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 548/1093] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:37.505137 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690d738-5be5-4716-bacb-3a321b25272a None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:37.505587 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690d738-5be5-4716-bacb-3a321b25272a None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:37.505692 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690d738-5be5-4716-bacb-3a321b25272a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:37.526288 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-d690d738-5be5-4716-bacb-3a321b25272a None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:37.527513 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-d690d738-5be5-4716-bacb-3a321b25272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:37.536823 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 546/1094] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:42:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:37.566540 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6bc12-45d2-417f-8a07-2700aedd301c None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:37.579508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6bc12-45d2-417f-8a07-2700aedd301c None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:37.584224 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979840cf-e838-4dc9-a171-a92cc8afa4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:37.584859 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979840cf-e838-4dc9-a171-a92cc8afa4ea admin admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:37.585175 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979840cf-e838-4dc9-a171-a92cc8afa4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:37.585445 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979840cf-e838-4dc9-a171-a92cc8afa4ea admin admin] PATH_INFO: `/v3/projects` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:37.586071 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979840cf-e838-4dc9-a171-a92cc8afa4ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:37.587880 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: WARNING py.warnings [None req-979840cf-e838-4dc9-a171-a92cc8afa4ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:42:37.587880 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: warnings.warn(msg) Aug 06 20:42:37.587880 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: Aug 06 20:42:37.589123 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979840cf-e838-4dc9-a171-a92cc8afa4ea admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:37.607183 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 549/1095] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Aug 6 20:42:37 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:42:39.852904 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7a57b-ed18-4d75-9250-1cdc5619030b None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:39.853826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7a57b-ed18-4d75-9250-1cdc5619030b None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:39.853826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7a57b-ed18-4d75-9250-1cdc5619030b None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:39.855890 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 547/1096] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:42:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:39.863926 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119c160-da56-44ca-bef9-9547a0451ca0 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:39.864388 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119c160-da56-44ca-bef9-9547a0451ca0 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:39.864498 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119c160-da56-44ca-bef9-9547a0451ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:39.884156 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-2119c160-da56-44ca-bef9-9547a0451ca0 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:39.885357 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-2119c160-da56-44ca-bef9-9547a0451ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:39.893786 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 550/1097] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:42:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:42:39.939688 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7a57b-ed18-4d75-9250-1cdc5619030b None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:39.958391 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7a57b-ed18-4d75-9250-1cdc5619030b None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:39.964081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10730a-c75b-4ce0-9c0b-b9d72fb38dde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:39.964687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10730a-c75b-4ce0-9c0b-b9d72fb38dde service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:39.964956 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10730a-c75b-4ce0-9c0b-b9d72fb38dde service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:39.965218 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10730a-c75b-4ce0-9c0b-b9d72fb38dde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:39.973688 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10730a-c75b-4ce0-9c0b-b9d72fb38dde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:39.975328 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10730a-c75b-4ce0-9c0b-b9d72fb38dde service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:39.985175 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 548/1098] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:42.394395 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609375f1-e56a-426c-a80c-6056a8e22c21 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:42.395056 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609375f1-e56a-426c-a80c-6056a8e22c21 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:42.395056 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609375f1-e56a-426c-a80c-6056a8e22c21 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:42.396301 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 551/1099] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:42.402706 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be51443-06ea-4540-86ff-d2ad18ee64c0 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:42.403185 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be51443-06ea-4540-86ff-d2ad18ee64c0 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:42.403289 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be51443-06ea-4540-86ff-d2ad18ee64c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:42.427626 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-4be51443-06ea-4540-86ff-d2ad18ee64c0 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:42.428855 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-4be51443-06ea-4540-86ff-d2ad18ee64c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:42.438227 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 549/1100] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:42:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:42.476278 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609375f1-e56a-426c-a80c-6056a8e22c21 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:42.487475 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609375f1-e56a-426c-a80c-6056a8e22c21 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:42.491477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d782a0-7dc9-4435-84cf-365cc4ac403b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:42.492069 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d782a0-7dc9-4435-84cf-365cc4ac403b service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:42.492345 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d782a0-7dc9-4435-84cf-365cc4ac403b service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:42.492608 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d782a0-7dc9-4435-84cf-365cc4ac403b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:42.502122 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d782a0-7dc9-4435-84cf-365cc4ac403b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:42.503604 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d782a0-7dc9-4435-84cf-365cc4ac403b service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:42.513121 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 552/1101] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:44.749964 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad8f61-f459-4883-a2de-0dcbff0cc490 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:44.750554 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad8f61-f459-4883-a2de-0dcbff0cc490 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:44.750554 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad8f61-f459-4883-a2de-0dcbff0cc490 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:44.751879 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 550/1102] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:44.757629 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77051c3-1935-4737-8cca-0a64d876decd None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:44.758089 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77051c3-1935-4737-8cca-0a64d876decd None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:44.758204 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77051c3-1935-4737-8cca-0a64d876decd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:44.778531 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-d77051c3-1935-4737-8cca-0a64d876decd None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:44.779777 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-d77051c3-1935-4737-8cca-0a64d876decd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:44.789568 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 553/1103] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:42:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:44.836707 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad8f61-f459-4883-a2de-0dcbff0cc490 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:44.848755 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad8f61-f459-4883-a2de-0dcbff0cc490 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:44.853435 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d198ba0-744e-4990-83fb-1f45d3456286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:44.854047 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d198ba0-744e-4990-83fb-1f45d3456286 service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:44.854314 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d198ba0-744e-4990-83fb-1f45d3456286 service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:44.854613 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d198ba0-744e-4990-83fb-1f45d3456286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:44.865089 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d198ba0-744e-4990-83fb-1f45d3456286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:44.866769 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d198ba0-744e-4990-83fb-1f45d3456286 service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:44.876490 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 551/1104] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:47.175290 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ead64f-4ccd-47c1-8152-be9bb74befe0 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:47.175886 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ead64f-4ccd-47c1-8152-be9bb74befe0 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:47.175886 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ead64f-4ccd-47c1-8152-be9bb74befe0 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:47.177967 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 554/1105] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:42:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:47.186828 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2bafd-3d59-4c02-90bb-015911623490 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:47.187261 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2bafd-3d59-4c02-90bb-015911623490 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:47.187383 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2bafd-3d59-4c02-90bb-015911623490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:47.210497 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-9ee2bafd-3d59-4c02-90bb-015911623490 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:47.211714 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-9ee2bafd-3d59-4c02-90bb-015911623490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:47.224903 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 552/1106] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:42:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:47.266834 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ead64f-4ccd-47c1-8152-be9bb74befe0 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:47.284222 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ead64f-4ccd-47c1-8152-be9bb74befe0 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:47.291375 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c76ba-d911-43cd-86d5-253813ecab1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:47.292289 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c76ba-d911-43cd-86d5-253813ecab1b service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:47.292694 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c76ba-d911-43cd-86d5-253813ecab1b service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:47.293065 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c76ba-d911-43cd-86d5-253813ecab1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:47.306790 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c76ba-d911-43cd-86d5-253813ecab1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:47.308268 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c76ba-d911-43cd-86d5-253813ecab1b service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:47.318725 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 555/1107] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:42:49.727343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669f016-6757-4d33-9eaf-1cf562ba2f93 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:49.728209 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669f016-6757-4d33-9eaf-1cf562ba2f93 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:49.728209 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669f016-6757-4d33-9eaf-1cf562ba2f93 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:49.730179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 553/1108] 10.222.0.36 () {54 vars in 927 bytes} [Sat Aug 6 20:42:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:49.736417 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ba709-5738-40d9-95e5-27147f034704 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:49.737105 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ba709-5738-40d9-95e5-27147f034704 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:49.737272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ba709-5738-40d9-95e5-27147f034704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:49.758821 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-968ba709-5738-40d9-95e5-27147f034704 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:49.760031 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-968ba709-5738-40d9-95e5-27147f034704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:49.769292 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 556/1109] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Aug 6 20:42:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:49.825142 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669f016-6757-4d33-9eaf-1cf562ba2f93 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:49.839444 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669f016-6757-4d33-9eaf-1cf562ba2f93 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:49.846484 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f4c4e-d5d9-41f0-9dde-711a2e3ffb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:49.847133 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f4c4e-d5d9-41f0-9dde-711a2e3ffb4e service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:49.847405 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f4c4e-d5d9-41f0-9dde-711a2e3ffb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:49.847672 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f4c4e-d5d9-41f0-9dde-711a2e3ffb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:49.857548 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f4c4e-d5d9-41f0-9dde-711a2e3ffb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:49.859057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f4c4e-d5d9-41f0-9dde-711a2e3ffb4e service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:49.868725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 554/1110] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:59.753977 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=33 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:59.864668 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=33 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:24.185701 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c22509-ea4a-4f2a-86ad-c52286133bc3 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:24.186370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c22509-ea4a-4f2a-86ad-c52286133bc3 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:24.186370 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c22509-ea4a-4f2a-86ad-c52286133bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:24.210686 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-b0c22509-ea4a-4f2a-86ad-c52286133bc3 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:24.212596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-b0c22509-ea4a-4f2a-86ad-c52286133bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:24.225637 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 557/1111] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:44:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:24.235255 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cada1a-ad33-45fb-9df2-a50a114a93df None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:24.235878 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cada1a-ad33-45fb-9df2-a50a114a93df None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:24.235878 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cada1a-ad33-45fb-9df2-a50a114a93df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:24.256502 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-24cada1a-ad33-45fb-9df2-a50a114a93df None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:24.257610 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-24cada1a-ad33-45fb-9df2-a50a114a93df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:24.266000 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 555/1112] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:44:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:24.271022 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c22509-ea4a-4f2a-86ad-c52286133bc3 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:24.281176 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c22509-ea4a-4f2a-86ad-c52286133bc3 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:24.286895 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf01fc-26bd-4bee-b7c3-a29409161711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:24.287500 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf01fc-26bd-4bee-b7c3-a29409161711 admin admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:24.287774 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf01fc-26bd-4bee-b7c3-a29409161711 admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:24.288037 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf01fc-26bd-4bee-b7c3-a29409161711 admin admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:24.288670 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf01fc-26bd-4bee-b7c3-a29409161711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:44:24.288977 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf01fc-26bd-4bee-b7c3-a29409161711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:24.290004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: WARNING py.warnings [None req-35cf01fc-26bd-4bee-b7c3-a29409161711 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:44:24.290004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: warnings.warn(msg) Aug 06 20:44:24.290004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: Aug 06 20:44:24.290927 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf01fc-26bd-4bee-b7c3-a29409161711 admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:24.303670 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 558/1113] 10.222.0.36 () {58 vars in 1153 bytes} [Sat Aug 6 20:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:44:24.312834 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cada1a-ad33-45fb-9df2-a50a114a93df None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:24.327145 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cada1a-ad33-45fb-9df2-a50a114a93df None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:24.336191 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0408c4-4df7-42ed-a273-69b330aa2043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:24.337048 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0408c4-4df7-42ed-a273-69b330aa2043 admin admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:24.337322 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0408c4-4df7-42ed-a273-69b330aa2043 admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:24.337645 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0408c4-4df7-42ed-a273-69b330aa2043 admin admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:24.338564 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0408c4-4df7-42ed-a273-69b330aa2043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:24.341350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: WARNING py.warnings [None req-0c0408c4-4df7-42ed-a273-69b330aa2043 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:44:24.341350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: warnings.warn(msg) Aug 06 20:44:24.341350 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: Aug 06 20:44:24.342551 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0408c4-4df7-42ed-a273-69b330aa2043 admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:24.372766 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 556/1114] 10.222.0.36 () {60 vars in 1153 bytes} [Sat Aug 6 20:44:24 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:44:24.377245 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf01fc-26bd-4bee-b7c3-a29409161711 admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:24.387596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf01fc-26bd-4bee-b7c3-a29409161711 admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:24.451809 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40fb4e-c189-47ef-b30f-8b4b523b2a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:24.452456 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40fb4e-c189-47ef-b30f-8b4b523b2a24 admin admin] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:24.452736 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40fb4e-c189-47ef-b30f-8b4b523b2a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:24.453005 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40fb4e-c189-47ef-b30f-8b4b523b2a24 admin admin] PATH_INFO: `/v3/users` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:24.453628 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40fb4e-c189-47ef-b30f-8b4b523b2a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:24.454697 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: WARNING py.warnings [None req-2a40fb4e-c189-47ef-b30f-8b4b523b2a24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:44:24.454697 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: warnings.warn(msg) Aug 06 20:44:24.454697 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: Aug 06 20:44:24.455908 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40fb4e-c189-47ef-b30f-8b4b523b2a24 admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:24.479458 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 559/1115] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Aug 6 20:44:24 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:44:24.483673 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0408c4-4df7-42ed-a273-69b330aa2043 admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:24.494179 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0408c4-4df7-42ed-a273-69b330aa2043 admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:24.499536 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ca4b6-b058-441c-9704-63fd25f835c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:24.500140 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ca4b6-b058-441c-9704-63fd25f835c2 admin admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:24.500415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ca4b6-b058-441c-9704-63fd25f835c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:24.500690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ca4b6-b058-441c-9704-63fd25f835c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:24.501325 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ca4b6-b058-441c-9704-63fd25f835c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:24.502338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: WARNING py.warnings [None req-639ca4b6-b058-441c-9704-63fd25f835c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:44:24.502338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: warnings.warn(msg) Aug 06 20:44:24.502338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: Aug 06 20:44:24.503294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ca4b6-b058-441c-9704-63fd25f835c2 admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:24.516012 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 557/1116] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Aug 6 20:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:44:24.520159 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40fb4e-c189-47ef-b30f-8b4b523b2a24 admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:24.530395 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40fb4e-c189-47ef-b30f-8b4b523b2a24 admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:24.535136 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c2e4a-7e1f-41cc-9832-eb309cb1e51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:24.535729 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c2e4a-7e1f-41cc-9832-eb309cb1e51e admin admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:24.536004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c2e4a-7e1f-41cc-9832-eb309cb1e51e admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:24.536271 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c2e4a-7e1f-41cc-9832-eb309cb1e51e admin admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:24.536910 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c2e4a-7e1f-41cc-9832-eb309cb1e51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:24.537952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: WARNING py.warnings [None req-d46c2e4a-7e1f-41cc-9832-eb309cb1e51e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:44:24.537952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: warnings.warn(msg) Aug 06 20:44:24.537952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: Aug 06 20:44:24.538858 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c2e4a-7e1f-41cc-9832-eb309cb1e51e admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:24.551803 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 560/1117] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Aug 6 20:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:44:24.556168 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ca4b6-b058-441c-9704-63fd25f835c2 admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:24.566480 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ca4b6-b058-441c-9704-63fd25f835c2 admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:24.572269 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e659417-6ccc-48fc-876d-ea5355e76578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:24.572928 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e659417-6ccc-48fc-876d-ea5355e76578 admin admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:24.573841 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e659417-6ccc-48fc-876d-ea5355e76578 admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:24.574418 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e659417-6ccc-48fc-876d-ea5355e76578 admin admin] PATH_INFO: `/v3/projects/a665f8600d9746da91928def30e5e1d3/users/55d3eea36d1a42abb2b61776e92dece7/roles/3b2a5b7c44354447b2bcac96e039c227` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:24.590813 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e659417-6ccc-48fc-876d-ea5355e76578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a665f8600d9746da91928def30e5e1d3, user_id=55d3eea36d1a42abb2b61776e92dece7, role_id=3b2a5b7c44354447b2bcac96e039c227)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:24.591902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: WARNING py.warnings [None req-6e659417-6ccc-48fc-876d-ea5355e76578 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:44:24.591902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: warnings.warn(msg) Aug 06 20:44:24.591902 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: Aug 06 20:44:24.593823 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e659417-6ccc-48fc-876d-ea5355e76578 admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:24.610945 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 558/1118] 10.222.0.36 () {60 vars in 1483 bytes} [Sat Aug 6 20:44:24 2022] PUT /identity/v3/projects/a665f8600d9746da91928def30e5e1d3/users/55d3eea36d1a42abb2b61776e92dece7/roles/3b2a5b7c44354447b2bcac96e039c227 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:44:24.623865 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb95ea-5962-46fa-a76e-afaba59f6900 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:24.624170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb95ea-5962-46fa-a76e-afaba59f6900 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:24.624502 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb95ea-5962-46fa-a76e-afaba59f6900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:24.655291 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-efcb95ea-5962-46fa-a76e-afaba59f6900 None None] MFA Rules not processed for user `55d3eea36d1a42abb2b61776e92dece7`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:24.656488 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-efcb95ea-5962-46fa-a76e-afaba59f6900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:24.874752 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 561/1119] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:44:24 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:24.891651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feddf10-59ce-4506-8304-d86998f57020 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:24.891929 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feddf10-59ce-4506-8304-d86998f57020 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:24.892194 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feddf10-59ce-4506-8304-d86998f57020 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:24.893877 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 559/1120] 10.222.0.36 () {54 vars in 964 bytes} [Sat Aug 6 20:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:24.899723 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325c447-7ebf-4054-91da-ba1e443f5b64 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:24.900031 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325c447-7ebf-4054-91da-ba1e443f5b64 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:24.900342 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325c447-7ebf-4054-91da-ba1e443f5b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:24.926004 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-3325c447-7ebf-4054-91da-ba1e443f5b64 None None] MFA Rules not processed for user `df2a0a27fb2b48d0b5210f0263639e47`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:24.927236 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-3325c447-7ebf-4054-91da-ba1e443f5b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:24.975763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:24.985167 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 562/1121] 10.222.0.36 () {58 vars in 1061 bytes} [Sat Aug 6 20:44:24 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:24.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feddf10-59ce-4506-8304-d86998f57020 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:25.006748 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feddf10-59ce-4506-8304-d86998f57020 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:25.011054 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0e498-0573-4b74-8430-4d85c5614173 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df2a0a27fb2b48d0b5210f0263639e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:25.011649 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0e498-0573-4b74-8430-4d85c5614173 service cinder] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:25.011925 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0e498-0573-4b74-8430-4d85c5614173 service cinder] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:25.012194 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0e498-0573-4b74-8430-4d85c5614173 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:25.020563 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0e498-0573-4b74-8430-4d85c5614173 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:25.021999 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0e498-0573-4b74-8430-4d85c5614173 service cinder] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:25.030826 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 560/1122] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:24 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:25.074739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efff5a1-f23e-45ff-a9d2-dbb60039f9e5 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:25.075017 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efff5a1-f23e-45ff-a9d2-dbb60039f9e5 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:25.075277 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efff5a1-f23e-45ff-a9d2-dbb60039f9e5 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:25.076508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 563/1123] 10.222.0.36 () {52 vars in 830 bytes} [Sat Aug 6 20:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:25.080433 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0e498-0573-4b74-8430-4d85c5614173 service cinder] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:25.153028 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0e498-0573-4b74-8430-4d85c5614173 service cinder] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:25.159418 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9925c4b-a8e2-4bf2-93a4-aed00a3da75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:25.160049 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9925c4b-a8e2-4bf2-93a4-aed00a3da75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:25.160326 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9925c4b-a8e2-4bf2-93a4-aed00a3da75f admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:25.160595 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9925c4b-a8e2-4bf2-93a4-aed00a3da75f admin admin] PATH_INFO: `/v3/users/55d3eea36d1a42abb2b61776e92dece7` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:25.161814 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9925c4b-a8e2-4bf2-93a4-aed00a3da75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d3eea36d1a42abb2b61776e92dece7)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:25.162850 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: WARNING py.warnings [None req-b9925c4b-a8e2-4bf2-93a4-aed00a3da75f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:44:25.162850 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: warnings.warn(msg) Aug 06 20:44:25.162850 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: Aug 06 20:44:25.164057 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9925c4b-a8e2-4bf2-93a4-aed00a3da75f admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:25.245421 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-b9925c4b-a8e2-4bf2-93a4-aed00a3da75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d3eea36d1a42abb2b61776e92dece7'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:44:25.272193 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-b9925c4b-a8e2-4bf2-93a4-aed00a3da75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d3eea36d1a42abb2b61776e92dece7'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:44:25.286791 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-b9925c4b-a8e2-4bf2-93a4-aed00a3da75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d3eea36d1a42abb2b61776e92dece7'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:44:25.287595 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-b9925c4b-a8e2-4bf2-93a4-aed00a3da75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d3eea36d1a42abb2b61776e92dece7'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:44:25.300522 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-b9925c4b-a8e2-4bf2-93a4-aed00a3da75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d3eea36d1a42abb2b61776e92dece7'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:44:25.307312 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 561/1124] 10.222.0.36 () {58 vars in 1224 bytes} [Sat Aug 6 20:44:25 2022] DELETE /identity/v3/users/55d3eea36d1a42abb2b61776e92dece7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:44:25.312054 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5394048-a034-417c-bfc7-6adf28c4ad60 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:25.312525 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5394048-a034-417c-bfc7-6adf28c4ad60 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:25.312621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5394048-a034-417c-bfc7-6adf28c4ad60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:25.332708 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-f5394048-a034-417c-bfc7-6adf28c4ad60 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:25.333864 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-f5394048-a034-417c-bfc7-6adf28c4ad60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:25.395768 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 564/1125] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:44:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:25.408279 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9925c4b-a8e2-4bf2-93a4-aed00a3da75f admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:25.409713 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-b9925c4b-a8e2-4bf2-93a4-aed00a3da75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:25.415348 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:25.472233 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9925c4b-a8e2-4bf2-93a4-aed00a3da75f admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:25.477140 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d4879-405d-45c2-81a1-01418f7ed855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:25.477732 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d4879-405d-45c2-81a1-01418f7ed855 service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:25.478003 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d4879-405d-45c2-81a1-01418f7ed855 service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:25.478269 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d4879-405d-45c2-81a1-01418f7ed855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:25.489578 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d4879-405d-45c2-81a1-01418f7ed855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:25.491061 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d4879-405d-45c2-81a1-01418f7ed855 service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:25.500929 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 562/1126] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:44:25.893933 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5394048-a034-417c-bfc7-6adf28c4ad60 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:25.895545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-f5394048-a034-417c-bfc7-6adf28c4ad60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:25.913581 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5394048-a034-417c-bfc7-6adf28c4ad60 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:25.913581 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90d711-f7df-4478-83c2-aedac9c9ccb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:25.914689 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90d711-f7df-4478-83c2-aedac9c9ccb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:25.914689 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90d711-f7df-4478-83c2-aedac9c9ccb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:25.914689 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90d711-f7df-4478-83c2-aedac9c9ccb2 admin admin] PATH_INFO: `/v3/projects/a665f8600d9746da91928def30e5e1d3` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:25.915935 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90d711-f7df-4478-83c2-aedac9c9ccb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a665f8600d9746da91928def30e5e1d3)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:25.917201 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: WARNING py.warnings [None req-fc90d711-f7df-4478-83c2-aedac9c9ccb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:44:25.917201 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: warnings.warn(msg) Aug 06 20:44:25.917201 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: Aug 06 20:44:25.918617 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90d711-f7df-4478-83c2-aedac9c9ccb2 admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:25.981680 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-fc90d711-f7df-4478-83c2-aedac9c9ccb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a665f8600d9746da91928def30e5e1d3', 'request_id': 'req-fc90d711-f7df-4478-83c2-aedac9c9ccb2'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:44:25.994295 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-fc90d711-f7df-4478-83c2-aedac9c9ccb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a665f8600d9746da91928def30e5e1d3', 'request_id': 'req-fc90d711-f7df-4478-83c2-aedac9c9ccb2'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:44:26.006856 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-fc90d711-f7df-4478-83c2-aedac9c9ccb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a665f8600d9746da91928def30e5e1d3', 'request_id': 'req-fc90d711-f7df-4478-83c2-aedac9c9ccb2'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:44:26.023302 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-fc90d711-f7df-4478-83c2-aedac9c9ccb2 admin admin] The token cache is being invalidate because project a665f8600d9746da91928def30e5e1d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:44:26.023800 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-fc90d711-f7df-4478-83c2-aedac9c9ccb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:44:26.024938 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-fc90d711-f7df-4478-83c2-aedac9c9ccb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:44:26.027425 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 565/1127] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Aug 6 20:44:25 2022] DELETE /identity/v3/projects/a665f8600d9746da91928def30e5e1d3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:44:35.496620 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=25 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:36.018116 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:49.513389 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea024875-d17f-4436-bdff-d57ab413d8f5 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:49.514172 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea024875-d17f-4436-bdff-d57ab413d8f5 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:49.514172 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea024875-d17f-4436-bdff-d57ab413d8f5 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:49.516308 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 563/1128] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:45:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:49.522273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023979d-f383-4ec2-91e8-1d86c2a38119 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:49.523051 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023979d-f383-4ec2-91e8-1d86c2a38119 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:49.523186 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023979d-f383-4ec2-91e8-1d86c2a38119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:49.611784 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-0023979d-f383-4ec2-91e8-1d86c2a38119 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:49.612997 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-0023979d-f383-4ec2-91e8-1d86c2a38119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:49.713107 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 566/1129] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:45:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:49.869585 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea024875-d17f-4436-bdff-d57ab413d8f5 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:49.872878 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-ea024875-d17f-4436-bdff-d57ab413d8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:49.971879 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea024875-d17f-4436-bdff-d57ab413d8f5 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:49.978110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d47e5-4809-4ccb-bdb6-779a779a4931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:49.978747 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d47e5-4809-4ccb-bdb6-779a779a4931 service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:49.979024 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d47e5-4809-4ccb-bdb6-779a779a4931 service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:49.979294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d47e5-4809-4ccb-bdb6-779a779a4931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:49.988659 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d47e5-4809-4ccb-bdb6-779a779a4931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:49.990247 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d47e5-4809-4ccb-bdb6-779a779a4931 service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:50.000646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 564/1130] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:50.833808 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c52b7e-c80f-4f62-a50f-42106476d5b8 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:50.834408 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c52b7e-c80f-4f62-a50f-42106476d5b8 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:50.834408 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c52b7e-c80f-4f62-a50f-42106476d5b8 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:50.836433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 567/1131] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:45:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:50.841418 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90b465-3ed1-43ba-a678-57b5d37cda49 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:50.841872 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90b465-3ed1-43ba-a678-57b5d37cda49 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:50.841975 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90b465-3ed1-43ba-a678-57b5d37cda49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:50.863723 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-3f90b465-3ed1-43ba-a678-57b5d37cda49 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:50.864936 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-3f90b465-3ed1-43ba-a678-57b5d37cda49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:50.874233 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 565/1132] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:45:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:51.043141 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c52b7e-c80f-4f62-a50f-42106476d5b8 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:51.065844 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c52b7e-c80f-4f62-a50f-42106476d5b8 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:51.071319 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34c78c-64cd-426b-9a70-8b2a67544ec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:51.071915 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34c78c-64cd-426b-9a70-8b2a67544ec8 service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:51.072185 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34c78c-64cd-426b-9a70-8b2a67544ec8 service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:51.072478 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34c78c-64cd-426b-9a70-8b2a67544ec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:51.080974 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34c78c-64cd-426b-9a70-8b2a67544ec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:51.082554 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34c78c-64cd-426b-9a70-8b2a67544ec8 service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:51.092040 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 568/1133] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:55.674335 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96f42a-753d-4f46-9832-eacd82a8cf43 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:55.674967 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96f42a-753d-4f46-9832-eacd82a8cf43 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:55.674967 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96f42a-753d-4f46-9832-eacd82a8cf43 None None] PATH_INFO: `/v3` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:55.676201 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 566/1134] 10.222.0.39 () {54 vars in 925 bytes} [Sat Aug 6 20:45:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:45:55.682951 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61944343-945d-4f87-8f20-bace717c07ff None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:55.683397 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61944343-945d-4f87-8f20-bace717c07ff None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:55.683582 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61944343-945d-4f87-8f20-bace717c07ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:55.715861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-61944343-945d-4f87-8f20-bace717c07ff None None] MFA Rules not processed for user `47953125a0e64fef8f36c17b3504e9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:55.717097 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-61944343-945d-4f87-8f20-bace717c07ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:55.775657 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:55.786134 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 569/1135] 10.222.0.39 () {58 vars in 1015 bytes} [Sat Aug 6 20:45:55 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:00.858475 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=42 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:02.353889 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b730975-aec3-43f3-8355-be1c1f043f4a None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:02.354947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b730975-aec3-43f3-8355-be1c1f043f4a None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:02.354947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b730975-aec3-43f3-8355-be1c1f043f4a None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:02.357616 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 567/1136] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:46:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:02.364027 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1aef6-e188-4853-a1e5-80c896639a61 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:02.364565 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1aef6-e188-4853-a1e5-80c896639a61 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:02.365248 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1aef6-e188-4853-a1e5-80c896639a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:02.385761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-e6d1aef6-e188-4853-a1e5-80c896639a61 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:02.386993 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-e6d1aef6-e188-4853-a1e5-80c896639a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:02.394715 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 570/1137] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:46:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:02.569887 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b730975-aec3-43f3-8355-be1c1f043f4a None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:02.589259 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b730975-aec3-43f3-8355-be1c1f043f4a None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:02.595042 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626d590-a2d1-4f9f-8ad3-ba6added533e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:02.595641 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626d590-a2d1-4f9f-8ad3-ba6added533e service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:02.595912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626d590-a2d1-4f9f-8ad3-ba6added533e service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:02.596175 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626d590-a2d1-4f9f-8ad3-ba6added533e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:02.605212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626d590-a2d1-4f9f-8ad3-ba6added533e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:02.606797 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626d590-a2d1-4f9f-8ad3-ba6added533e service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:02.617147 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 568/1138] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:03.433741 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928bf79-e77a-43dd-8acb-c3c3b2b4e8fd None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:03.434623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928bf79-e77a-43dd-8acb-c3c3b2b4e8fd None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:03.434623 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928bf79-e77a-43dd-8acb-c3c3b2b4e8fd None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:03.436675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 571/1139] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:46:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:03.442806 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c683dcf-486c-4ccb-9db6-e06e01531d21 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:03.443839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c683dcf-486c-4ccb-9db6-e06e01531d21 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:03.443839 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c683dcf-486c-4ccb-9db6-e06e01531d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:03.470343 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-0c683dcf-486c-4ccb-9db6-e06e01531d21 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:03.471569 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-0c683dcf-486c-4ccb-9db6-e06e01531d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:03.481326 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 569/1140] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:46:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:03.643067 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928bf79-e77a-43dd-8acb-c3c3b2b4e8fd None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:03.665339 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928bf79-e77a-43dd-8acb-c3c3b2b4e8fd None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:03.671847 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d3c60-1088-4c7d-baaa-759e7cbb6aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:03.672449 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d3c60-1088-4c7d-baaa-759e7cbb6aa4 service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:03.672719 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d3c60-1088-4c7d-baaa-759e7cbb6aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:03.672984 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d3c60-1088-4c7d-baaa-759e7cbb6aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:03.681999 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d3c60-1088-4c7d-baaa-759e7cbb6aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:03.683634 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d3c60-1088-4c7d-baaa-759e7cbb6aa4 service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:03.693696 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 572/1141] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:04.962084 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9857b5-ccde-41a4-98c2-48a9bef52a8c None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:04.963023 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9857b5-ccde-41a4-98c2-48a9bef52a8c None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:04.963023 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9857b5-ccde-41a4-98c2-48a9bef52a8c None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:04.965129 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 570/1142] 10.222.0.36 () {54 vars in 961 bytes} [Sat Aug 6 20:46:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:04.973762 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db78b3-dd25-4e3a-a97a-950f047bb9d4 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:04.974220 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db78b3-dd25-4e3a-a97a-950f047bb9d4 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:04.974381 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db78b3-dd25-4e3a-a97a-950f047bb9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:04.995848 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-c5db78b3-dd25-4e3a-a97a-950f047bb9d4 None None] MFA Rules not processed for user `47953125a0e64fef8f36c17b3504e9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:04.997048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-c5db78b3-dd25-4e3a-a97a-950f047bb9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:05.007859 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 573/1143] 10.222.0.36 () {58 vars in 1058 bytes} [Sat Aug 6 20:46:04 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:05.016870 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9857b5-ccde-41a4-98c2-48a9bef52a8c None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:05.032603 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9857b5-ccde-41a4-98c2-48a9bef52a8c None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:05.038790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29b7f2-75db-4f1b-80e2-aea1db4c1099 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47953125a0e64fef8f36c17b3504e9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:05.039379 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29b7f2-75db-4f1b-80e2-aea1db4c1099 service placement] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:05.039650 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29b7f2-75db-4f1b-80e2-aea1db4c1099 service placement] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:05.039916 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29b7f2-75db-4f1b-80e2-aea1db4c1099 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:05.048536 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29b7f2-75db-4f1b-80e2-aea1db4c1099 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:05.050096 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29b7f2-75db-4f1b-80e2-aea1db4c1099 service placement] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:05.060257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 571/1144] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:05 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:14.942968 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478347bd-096a-4db0-aa2a-436f9eb0ee1c None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:14.943528 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478347bd-096a-4db0-aa2a-436f9eb0ee1c None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:14.943528 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478347bd-096a-4db0-aa2a-436f9eb0ee1c None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:14.945054 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 574/1145] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:46:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:14.950207 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693a4cd-019a-4a95-b02d-716f8fc966df None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:14.950697 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693a4cd-019a-4a95-b02d-716f8fc966df None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:14.950800 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693a4cd-019a-4a95-b02d-716f8fc966df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:14.972499 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-3693a4cd-019a-4a95-b02d-716f8fc966df None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:14.973692 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-3693a4cd-019a-4a95-b02d-716f8fc966df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:14.982823 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 572/1146] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:46:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:46:14.990754 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=12 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:15.151852 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478347bd-096a-4db0-aa2a-436f9eb0ee1c None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:15.165917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478347bd-096a-4db0-aa2a-436f9eb0ee1c None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:15.170968 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32859156-ba48-4b46-8cfd-911e2495a7df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:15.171565 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32859156-ba48-4b46-8cfd-911e2495a7df service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:15.171834 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32859156-ba48-4b46-8cfd-911e2495a7df service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:15.172100 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32859156-ba48-4b46-8cfd-911e2495a7df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:15.180308 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32859156-ba48-4b46-8cfd-911e2495a7df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:15.181895 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32859156-ba48-4b46-8cfd-911e2495a7df service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:15.191191 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 575/1147] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:16.018789 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce636c-3763-4f0a-9d14-5e5349df042b None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:16.019723 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce636c-3763-4f0a-9d14-5e5349df042b None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:16.019723 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce636c-3763-4f0a-9d14-5e5349df042b None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:16.021896 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 573/1148] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:46:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:16.029093 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ae22d-351f-4dad-b510-e3a2051b0121 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:16.029801 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ae22d-351f-4dad-b510-e3a2051b0121 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:16.029907 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ae22d-351f-4dad-b510-e3a2051b0121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:16.058241 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-090ae22d-351f-4dad-b510-e3a2051b0121 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:16.059486 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-090ae22d-351f-4dad-b510-e3a2051b0121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:16.069457 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 576/1149] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:46:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:16.231118 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce636c-3763-4f0a-9d14-5e5349df042b None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:16.255715 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce636c-3763-4f0a-9d14-5e5349df042b None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:16.261783 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c051f98-fffb-4fbd-91e8-c2a80f219e26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:16.262373 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c051f98-fffb-4fbd-91e8-c2a80f219e26 service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:16.262666 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c051f98-fffb-4fbd-91e8-c2a80f219e26 service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:16.262955 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c051f98-fffb-4fbd-91e8-c2a80f219e26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:16.271099 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c051f98-fffb-4fbd-91e8-c2a80f219e26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:16.272862 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c051f98-fffb-4fbd-91e8-c2a80f219e26 service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:16.282194 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 574/1150] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:20.342033 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40621ecc-68d0-4f25-9edc-c347562e1b0d None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:20.343124 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40621ecc-68d0-4f25-9edc-c347562e1b0d None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:20.343124 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40621ecc-68d0-4f25-9edc-c347562e1b0d None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:20.345417 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 577/1151] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:46:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:20.352203 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2583048-4e50-438b-89b3-266f1b8f4fcd None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:20.352981 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2583048-4e50-438b-89b3-266f1b8f4fcd None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:20.352981 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2583048-4e50-438b-89b3-266f1b8f4fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:20.379001 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-e2583048-4e50-438b-89b3-266f1b8f4fcd None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:20.380193 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-e2583048-4e50-438b-89b3-266f1b8f4fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:20.389859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 575/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:46:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:20.434988 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40621ecc-68d0-4f25-9edc-c347562e1b0d None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:20.438179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-40621ecc-68d0-4f25-9edc-c347562e1b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:20.504740 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40621ecc-68d0-4f25-9edc-c347562e1b0d None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:20.508817 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2233608-7ff8-42b6-b2e7-50e20a7ba1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:20.509415 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2233608-7ff8-42b6-b2e7-50e20a7ba1ee service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:20.509687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2233608-7ff8-42b6-b2e7-50e20a7ba1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:20.509959 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2233608-7ff8-42b6-b2e7-50e20a7ba1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:20.518964 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2233608-7ff8-42b6-b2e7-50e20a7ba1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:20.520391 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2233608-7ff8-42b6-b2e7-50e20a7ba1ee service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:20.529806 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 578/1153] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:22.723845 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e2aa4-5b6e-4fb3-adbe-ffdd6f9a1fa6 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:22.724830 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e2aa4-5b6e-4fb3-adbe-ffdd6f9a1fa6 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:22.724830 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e2aa4-5b6e-4fb3-adbe-ffdd6f9a1fa6 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:22.727610 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 576/1154] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:46:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:22.733539 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c10fe0-a96f-4e49-8b1f-08e5ae02ad00 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:22.733983 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c10fe0-a96f-4e49-8b1f-08e5ae02ad00 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:22.734091 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c10fe0-a96f-4e49-8b1f-08e5ae02ad00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:22.756993 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-86c10fe0-a96f-4e49-8b1f-08e5ae02ad00 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:22.758199 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-86c10fe0-a96f-4e49-8b1f-08e5ae02ad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:22.767280 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 579/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:46:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:22.805604 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e2aa4-5b6e-4fb3-adbe-ffdd6f9a1fa6 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:22.808534 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-0a6e2aa4-5b6e-4fb3-adbe-ffdd6f9a1fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:22.831111 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e2aa4-5b6e-4fb3-adbe-ffdd6f9a1fa6 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:22.837043 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7b604-197b-4c49-9a24-e7a92df596ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:22.837633 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7b604-197b-4c49-9a24-e7a92df596ea service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:22.837926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7b604-197b-4c49-9a24-e7a92df596ea service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:22.838193 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7b604-197b-4c49-9a24-e7a92df596ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:22.849489 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7b604-197b-4c49-9a24-e7a92df596ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:22.851341 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7b604-197b-4c49-9a24-e7a92df596ea service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:22.861344 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 577/1156] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:26.652843 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197a128-1eeb-415b-a13d-f409bfae4d66 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:26.653750 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197a128-1eeb-415b-a13d-f409bfae4d66 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:26.653750 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197a128-1eeb-415b-a13d-f409bfae4d66 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:26.655916 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 580/1157] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:46:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:26.661423 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664ba0c-5e58-4aa6-9adb-d031fcfc6745 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:26.661879 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664ba0c-5e58-4aa6-9adb-d031fcfc6745 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:26.661992 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664ba0c-5e58-4aa6-9adb-d031fcfc6745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:26.683193 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-e664ba0c-5e58-4aa6-9adb-d031fcfc6745 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:26.684362 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-e664ba0c-5e58-4aa6-9adb-d031fcfc6745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:26.692550 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 578/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:46:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:26.960534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197a128-1eeb-415b-a13d-f409bfae4d66 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:26.963575 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-9197a128-1eeb-415b-a13d-f409bfae4d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:27.027842 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197a128-1eeb-415b-a13d-f409bfae4d66 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:27.031761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864b157-f1ce-4348-ab4c-24c452cd4933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df2a0a27fb2b48d0b5210f0263639e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:27.032360 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864b157-f1ce-4348-ab4c-24c452cd4933 service cinder] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:27.032635 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864b157-f1ce-4348-ab4c-24c452cd4933 service cinder] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:27.032904 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864b157-f1ce-4348-ab4c-24c452cd4933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:27.042746 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864b157-f1ce-4348-ab4c-24c452cd4933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:27.044179 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864b157-f1ce-4348-ab4c-24c452cd4933 service cinder] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:27.053838 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 581/1159] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:29.269445 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ccfb7-53b8-4005-94fb-20507c4eca49 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:29.270042 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ccfb7-53b8-4005-94fb-20507c4eca49 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:29.270042 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ccfb7-53b8-4005-94fb-20507c4eca49 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:29.271457 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 579/1160] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:29.277034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615914f-a4e3-434f-9084-ca66cf89bc6e None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:29.277462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615914f-a4e3-434f-9084-ca66cf89bc6e None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:29.277572 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615914f-a4e3-434f-9084-ca66cf89bc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:29.299845 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-c615914f-a4e3-434f-9084-ca66cf89bc6e None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:29.301025 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-c615914f-a4e3-434f-9084-ca66cf89bc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:29.309135 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 582/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:46:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:29.578053 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ccfb7-53b8-4005-94fb-20507c4eca49 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:29.581229 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-9e7ccfb7-53b8-4005-94fb-20507c4eca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:29.602420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ccfb7-53b8-4005-94fb-20507c4eca49 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:29.609232 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f995ba-54d1-4e59-88fa-e30afd7163b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df2a0a27fb2b48d0b5210f0263639e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:29.610027 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f995ba-54d1-4e59-88fa-e30afd7163b9 service cinder] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:29.610317 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f995ba-54d1-4e59-88fa-e30afd7163b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:29.610601 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f995ba-54d1-4e59-88fa-e30afd7163b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:29.622369 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f995ba-54d1-4e59-88fa-e30afd7163b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:29.623840 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f995ba-54d1-4e59-88fa-e30afd7163b9 service cinder] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:29.633968 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 580/1162] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:39.295192 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=67 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:39.629547 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=42 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:44.141197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5ff15-0deb-4743-ac08-edafef03473b None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.141911 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567818cc-89b6-4d00-9aa4-1b5edb58a85c None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.141911 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567818cc-89b6-4d00-9aa4-1b5edb58a85c None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.142385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5ff15-0deb-4743-ac08-edafef03473b None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.142481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567818cc-89b6-4d00-9aa4-1b5edb58a85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.142574 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5ff15-0deb-4743-ac08-edafef03473b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.161404 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-567818cc-89b6-4d00-9aa4-1b5edb58a85c None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:44.161776 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-8bb5ff15-0deb-4743-ac08-edafef03473b None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:44.171331 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-567818cc-89b6-4d00-9aa4-1b5edb58a85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:44.171464 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-8bb5ff15-0deb-4743-ac08-edafef03473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:44.180009 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 583/1163] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:47:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:44.180462 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 581/1164] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:47:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:44.188524 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ad7a7-e6d4-4af9-bb49-02de47bab073 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.188705 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad223812-f493-4e1c-821e-c820ee1af50b None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.188816 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ad7a7-e6d4-4af9-bb49-02de47bab073 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.188919 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad223812-f493-4e1c-821e-c820ee1af50b None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.189063 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ad7a7-e6d4-4af9-bb49-02de47bab073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.189182 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad223812-f493-4e1c-821e-c820ee1af50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.209175 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-ad223812-f493-4e1c-821e-c820ee1af50b None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:44.209377 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-bb0ad7a7-e6d4-4af9-bb49-02de47bab073 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:44.210346 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-ad223812-f493-4e1c-821e-c820ee1af50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:44.210470 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-bb0ad7a7-e6d4-4af9-bb49-02de47bab073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:44.222397 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 582/1166] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:47:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:44.222559 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 584/1166] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:47:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:44.223533 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad223812-f493-4e1c-821e-c820ee1af50b None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.223687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ad7a7-e6d4-4af9-bb49-02de47bab073 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.232956 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ad7a7-e6d4-4af9-bb49-02de47bab073 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.233141 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad223812-f493-4e1c-821e-c820ee1af50b None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.237578 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7826aa-7d29-4119-b370-be8d55018c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.238040 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ac635-a064-45fd-9bef-e52c367f3487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.238170 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7826aa-7d29-4119-b370-be8d55018c4c admin admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.238452 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7826aa-7d29-4119-b370-be8d55018c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.238679 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ac635-a064-45fd-9bef-e52c367f3487 admin admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.238794 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7826aa-7d29-4119-b370-be8d55018c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.238951 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ac635-a064-45fd-9bef-e52c367f3487 admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.239223 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ac635-a064-45fd-9bef-e52c367f3487 admin admin] PATH_INFO: `/v3/domains` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.239343 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7826aa-7d29-4119-b370-be8d55018c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:47:44.239610 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7826aa-7d29-4119-b370-be8d55018c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.239870 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ac635-a064-45fd-9bef-e52c367f3487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:47:44.240199 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ac635-a064-45fd-9bef-e52c367f3487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.241232 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7826aa-7d29-4119-b370-be8d55018c4c admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.241384 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: WARNING py.warnings [None req-590ac635-a064-45fd-9bef-e52c367f3487 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:47:44.241384 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: warnings.warn(msg) Aug 06 20:47:44.241384 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: Aug 06 20:47:44.242152 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ac635-a064-45fd-9bef-e52c367f3487 admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.253026 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 585/1167] 10.222.0.36 () {58 vars in 1153 bytes} [Sat Aug 6 20:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:47:44.255102 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 583/1168] 10.222.0.36 () {58 vars in 1153 bytes} [Sat Aug 6 20:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:47:44.261066 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7826aa-7d29-4119-b370-be8d55018c4c admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.262833 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ac635-a064-45fd-9bef-e52c367f3487 admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.271189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7826aa-7d29-4119-b370-be8d55018c4c admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.272922 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ac635-a064-45fd-9bef-e52c367f3487 admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.275641 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a8595-0407-482d-b5f7-3271187c174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.276230 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a8595-0407-482d-b5f7-3271187c174e admin admin] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.276498 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a8595-0407-482d-b5f7-3271187c174e admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.276756 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a8595-0407-482d-b5f7-3271187c174e admin admin] PATH_INFO: `/v3/projects` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.277418 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a8595-0407-482d-b5f7-3271187c174e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.278188 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388672e5-53e2-494c-89b5-ba611939e11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.278635 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: WARNING py.warnings [None req-cc4a8595-0407-482d-b5f7-3271187c174e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:47:44.278635 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: warnings.warn(msg) Aug 06 20:47:44.278635 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: Aug 06 20:47:44.279110 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388672e5-53e2-494c-89b5-ba611939e11f admin admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.279403 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388672e5-53e2-494c-89b5-ba611939e11f admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.279676 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388672e5-53e2-494c-89b5-ba611939e11f admin admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.280036 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a8595-0407-482d-b5f7-3271187c174e admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.280290 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388672e5-53e2-494c-89b5-ba611939e11f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.282171 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388672e5-53e2-494c-89b5-ba611939e11f admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.322270 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 586/1169] 10.222.0.36 () {60 vars in 1153 bytes} [Sat Aug 6 20:47:44 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:47:44.323400 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a8595-0407-482d-b5f7-3271187c174e admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.324322 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 584/1170] 10.222.0.36 () {60 vars in 1153 bytes} [Sat Aug 6 20:47:44 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:47:44.328477 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388672e5-53e2-494c-89b5-ba611939e11f admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.386144 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a8595-0407-482d-b5f7-3271187c174e admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.389407 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388672e5-53e2-494c-89b5-ba611939e11f admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.390874 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfd9d2-5a14-4d05-a076-c7e5ef5c9216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.391485 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfd9d2-5a14-4d05-a076-c7e5ef5c9216 admin admin] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.391757 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfd9d2-5a14-4d05-a076-c7e5ef5c9216 admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.392025 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfd9d2-5a14-4d05-a076-c7e5ef5c9216 admin admin] PATH_INFO: `/v3/users` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.392645 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfd9d2-5a14-4d05-a076-c7e5ef5c9216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.394568 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfd9d2-5a14-4d05-a076-c7e5ef5c9216 admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.397987 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f0e05-e1e5-4073-8ad9-4d287a7714ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.398620 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f0e05-e1e5-4073-8ad9-4d287a7714ba admin admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.398890 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f0e05-e1e5-4073-8ad9-4d287a7714ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.399155 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f0e05-e1e5-4073-8ad9-4d287a7714ba admin admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.399766 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f0e05-e1e5-4073-8ad9-4d287a7714ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.400852 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: WARNING py.warnings [None req-231f0e05-e1e5-4073-8ad9-4d287a7714ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:47:44.400852 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: warnings.warn(msg) Aug 06 20:47:44.400852 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: Aug 06 20:47:44.402143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f0e05-e1e5-4073-8ad9-4d287a7714ba admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.417831 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 587/1171] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Aug 6 20:47:44 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:47:44.422254 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfd9d2-5a14-4d05-a076-c7e5ef5c9216 admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.424156 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 585/1172] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Aug 6 20:47:44 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:47:44.427567 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f0e05-e1e5-4073-8ad9-4d287a7714ba admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.431964 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfd9d2-5a14-4d05-a076-c7e5ef5c9216 admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.436885 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b5bec-7b21-4a2c-a017-42d20a0c5635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.437147 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f0e05-e1e5-4073-8ad9-4d287a7714ba admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.437481 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5bec-7b21-4a2c-a017-42d20a0c5635 admin admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.437758 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5bec-7b21-4a2c-a017-42d20a0c5635 admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.438027 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5bec-7b21-4a2c-a017-42d20a0c5635 admin admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.438699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b5bec-7b21-4a2c-a017-42d20a0c5635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.440327 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b5bec-7b21-4a2c-a017-42d20a0c5635 admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.442093 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732e199-02ab-4939-bdeb-43b9f318f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.442758 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732e199-02ab-4939-bdeb-43b9f318f42d admin admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.443015 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732e199-02ab-4939-bdeb-43b9f318f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.443280 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732e199-02ab-4939-bdeb-43b9f318f42d admin admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.443928 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732e199-02ab-4939-bdeb-43b9f318f42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.445882 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732e199-02ab-4939-bdeb-43b9f318f42d admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.450771 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 588/1173] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:44.454838 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b5bec-7b21-4a2c-a017-42d20a0c5635 admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.458751 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 586/1174] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:47:44.462649 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732e199-02ab-4939-bdeb-43b9f318f42d admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.464184 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b5bec-7b21-4a2c-a017-42d20a0c5635 admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.469592 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83116a-a3cf-459b-905f-1f94e2ecaf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.470188 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83116a-a3cf-459b-905f-1f94e2ecaf33 admin admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.470464 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83116a-a3cf-459b-905f-1f94e2ecaf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.470800 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83116a-a3cf-459b-905f-1f94e2ecaf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.471437 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83116a-a3cf-459b-905f-1f94e2ecaf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.473024 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83116a-a3cf-459b-905f-1f94e2ecaf33 admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.473380 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732e199-02ab-4939-bdeb-43b9f318f42d admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.479667 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e91f22-ec1e-4895-93df-40a6fd324aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.479936 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e91f22-ec1e-4895-93df-40a6fd324aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.480178 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e91f22-ec1e-4895-93df-40a6fd324aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.480444 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e91f22-ec1e-4895-93df-40a6fd324aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.481084 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e91f22-ec1e-4895-93df-40a6fd324aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.482676 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e91f22-ec1e-4895-93df-40a6fd324aa3 admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.484181 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 589/1175] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:44.488234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83116a-a3cf-459b-905f-1f94e2ecaf33 admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.493665 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 587/1176] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:47:44.498074 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e91f22-ec1e-4895-93df-40a6fd324aa3 admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.498263 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83116a-a3cf-459b-905f-1f94e2ecaf33 admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.502940 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823180fe-42f2-4d1f-90e8-d258f4a98654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.503603 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823180fe-42f2-4d1f-90e8-d258f4a98654 admin admin] REQUEST_METHOD: `PUT` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.503868 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823180fe-42f2-4d1f-90e8-d258f4a98654 admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.504135 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823180fe-42f2-4d1f-90e8-d258f4a98654 admin admin] PATH_INFO: `/v3/projects/f568ffc0725b48598742afd2a14785ea/users/2416219e665d4648b8505cb1147e721c/roles/3b2a5b7c44354447b2bcac96e039c227` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.507986 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e91f22-ec1e-4895-93df-40a6fd324aa3 admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.512494 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670080ed-db43-42ba-b6a6-cbd40f946d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.513139 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670080ed-db43-42ba-b6a6-cbd40f946d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.513445 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670080ed-db43-42ba-b6a6-cbd40f946d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.513732 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670080ed-db43-42ba-b6a6-cbd40f946d1f admin admin] PATH_INFO: `/v3/projects/e3c67bd59ef1469ab9a2015f1987d6f3/users/d97ddb5d77f24cf39c29501fede75baf/roles/3b2a5b7c44354447b2bcac96e039c227` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.518530 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823180fe-42f2-4d1f-90e8-d258f4a98654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f568ffc0725b48598742afd2a14785ea, user_id=2416219e665d4648b8505cb1147e721c, role_id=3b2a5b7c44354447b2bcac96e039c227)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.519593 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: WARNING py.warnings [None req-823180fe-42f2-4d1f-90e8-d258f4a98654 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:47:44.519593 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: warnings.warn(msg) Aug 06 20:47:44.519593 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: Aug 06 20:47:44.521554 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823180fe-42f2-4d1f-90e8-d258f4a98654 admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.529164 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670080ed-db43-42ba-b6a6-cbd40f946d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c67bd59ef1469ab9a2015f1987d6f3, user_id=d97ddb5d77f24cf39c29501fede75baf, role_id=3b2a5b7c44354447b2bcac96e039c227)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.532004 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670080ed-db43-42ba-b6a6-cbd40f946d1f admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.536462 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 590/1177] 10.222.0.36 () {60 vars in 1483 bytes} [Sat Aug 6 20:47:44 2022] PUT /identity/v3/projects/f568ffc0725b48598742afd2a14785ea/users/2416219e665d4648b8505cb1147e721c/roles/3b2a5b7c44354447b2bcac96e039c227 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:47:44.541734 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcc681-e969-40ce-927a-468fbb6b9bf8 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.542018 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcc681-e969-40ce-927a-468fbb6b9bf8 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.542291 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcc681-e969-40ce-927a-468fbb6b9bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.546185 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 588/1178] 10.222.0.36 () {60 vars in 1483 bytes} [Sat Aug 6 20:47:44 2022] PUT /identity/v3/projects/e3c67bd59ef1469ab9a2015f1987d6f3/users/d97ddb5d77f24cf39c29501fede75baf/roles/3b2a5b7c44354447b2bcac96e039c227 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:47:44.551165 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d7162-5b45-49c8-9fc8-921d79306cfb None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.551444 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d7162-5b45-49c8-9fc8-921d79306cfb None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.551708 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d7162-5b45-49c8-9fc8-921d79306cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.560731 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-59bcc681-e969-40ce-927a-468fbb6b9bf8 None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:44.561932 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-59bcc681-e969-40ce-927a-468fbb6b9bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:44.569505 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-c94d7162-5b45-49c8-9fc8-921d79306cfb None None] MFA Rules not processed for user `2d2bdc2d34c34554b4a922abe3128eee`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:44.570676 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-c94d7162-5b45-49c8-9fc8-921d79306cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:44.603955 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:44.614430 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:44.623001 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 591/1179] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:47:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:44.633765 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcc681-e969-40ce-927a-468fbb6b9bf8 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.640252 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 589/1180] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:47:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:47:44.646180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d7162-5b45-49c8-9fc8-921d79306cfb None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.693998 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcc681-e969-40ce-927a-468fbb6b9bf8 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.697959 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e82917-8513-4c36-965e-3fa3e54ad499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.698573 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e82917-8513-4c36-965e-3fa3e54ad499 service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.698871 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e82917-8513-4c36-965e-3fa3e54ad499 service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.699131 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e82917-8513-4c36-965e-3fa3e54ad499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.708710 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e82917-8513-4c36-965e-3fa3e54ad499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.710172 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e82917-8513-4c36-965e-3fa3e54ad499 service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.712835 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d7162-5b45-49c8-9fc8-921d79306cfb None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.716687 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f09ec-dde6-4349-a14f-b236a70e6497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.717299 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f09ec-dde6-4349-a14f-b236a70e6497 service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.717571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f09ec-dde6-4349-a14f-b236a70e6497 service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.717834 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f09ec-dde6-4349-a14f-b236a70e6497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.720587 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 592/1181] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:44.727747 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f09ec-dde6-4349-a14f-b236a70e6497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.729184 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f09ec-dde6-4349-a14f-b236a70e6497 service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.738878 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 590/1182] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:49.746632 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7dc2d-a84b-4673-982e-53e10973fe6d None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:49.747241 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7dc2d-a84b-4673-982e-53e10973fe6d None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:49.747432 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7dc2d-a84b-4673-982e-53e10973fe6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:49.804050 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-b9e7dc2d-a84b-4673-982e-53e10973fe6d None None] MFA Rules not processed for user `2416219e665d4648b8505cb1147e721c`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:49.807680 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-b9e7dc2d-a84b-4673-982e-53e10973fe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:49.932892 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 593/1183] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:47:49 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:49.934854 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f09ec-dde6-4349-a14f-b236a70e6497 service neutron] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:49.953076 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f09ec-dde6-4349-a14f-b236a70e6497 service neutron] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:49.968384 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b587e-cdf0-4673-8f18-edb95a0efd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:49.969385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b587e-cdf0-4673-8f18-edb95a0efd4e admin admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:49.969658 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b587e-cdf0-4673-8f18-edb95a0efd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:49.969925 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b587e-cdf0-4673-8f18-edb95a0efd4e admin admin] PATH_INFO: `/v3/projects` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:49.970556 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b587e-cdf0-4673-8f18-edb95a0efd4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:49.972654 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b587e-cdf0-4673-8f18-edb95a0efd4e admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:50.039143 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 591/1184] 10.222.0.36 () {60 vars in 1153 bytes} [Sat Aug 6 20:47:49 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:47:50.041046 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7dc2d-a84b-4673-982e-53e10973fe6d None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:50.056328 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7dc2d-a84b-4673-982e-53e10973fe6d None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:50.188137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952aaf0-d3bb-48bf-a539-a84d34fa44eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:50.188824 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952aaf0-d3bb-48bf-a539-a84d34fa44eb admin admin] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:50.189100 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952aaf0-d3bb-48bf-a539-a84d34fa44eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:50.189369 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952aaf0-d3bb-48bf-a539-a84d34fa44eb admin admin] PATH_INFO: `/v3/users` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:50.190312 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952aaf0-d3bb-48bf-a539-a84d34fa44eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:50.192487 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952aaf0-d3bb-48bf-a539-a84d34fa44eb admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:50.233679 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 594/1185] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Aug 6 20:47:50 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:47:50.237584 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b587e-cdf0-4673-8f18-edb95a0efd4e admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:50.250926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b587e-cdf0-4673-8f18-edb95a0efd4e admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:50.256926 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d317ae-c7a1-4412-bd27-2edb0f6d059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:50.257856 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d317ae-c7a1-4412-bd27-2edb0f6d059a admin admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:50.258280 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d317ae-c7a1-4412-bd27-2edb0f6d059a admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:50.258879 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d317ae-c7a1-4412-bd27-2edb0f6d059a admin admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:50.259674 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d317ae-c7a1-4412-bd27-2edb0f6d059a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:50.261459 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d317ae-c7a1-4412-bd27-2edb0f6d059a admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:50.302119 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 592/1186] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:50.306189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952aaf0-d3bb-48bf-a539-a84d34fa44eb admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:50.319306 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952aaf0-d3bb-48bf-a539-a84d34fa44eb admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:50.324905 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455f158-a3c9-4c6f-ad8b-040b24b9a98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:50.325596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455f158-a3c9-4c6f-ad8b-040b24b9a98f admin admin] REQUEST_METHOD: `PUT` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:50.325946 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455f158-a3c9-4c6f-ad8b-040b24b9a98f admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:50.326214 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455f158-a3c9-4c6f-ad8b-040b24b9a98f admin admin] PATH_INFO: `/v3/projects/60fbef26bc9341b99035db68441702be/users/055a96b0001e4b8ca0a417671d8f2fd5/roles/e62e78acab6b46f6a866b4980700caae` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:50.329863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:50.352063 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455f158-a3c9-4c6f-ad8b-040b24b9a98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fbef26bc9341b99035db68441702be, user_id=055a96b0001e4b8ca0a417671d8f2fd5, role_id=e62e78acab6b46f6a866b4980700caae)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:50.355231 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455f158-a3c9-4c6f-ad8b-040b24b9a98f admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:50.385207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 595/1187] 10.222.0.36 () {60 vars in 1483 bytes} [Sat Aug 6 20:47:50 2022] PUT /identity/v3/projects/60fbef26bc9341b99035db68441702be/users/055a96b0001e4b8ca0a417671d8f2fd5/roles/e62e78acab6b46f6a866b4980700caae => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:50.388850 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d317ae-c7a1-4412-bd27-2edb0f6d059a admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:50.400702 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d317ae-c7a1-4412-bd27-2edb0f6d059a admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:50.493741 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eed6a-ea5a-490e-8388-a92ec4cee7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:50.494371 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eed6a-ea5a-490e-8388-a92ec4cee7ba admin admin] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:50.494663 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eed6a-ea5a-490e-8388-a92ec4cee7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:50.494936 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eed6a-ea5a-490e-8388-a92ec4cee7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:50.501913 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853eed6a-ea5a-490e-8388-a92ec4cee7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:50.504387 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853eed6a-ea5a-490e-8388-a92ec4cee7ba admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:50.518626 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 593/1188] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:50.521844 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455f158-a3c9-4c6f-ad8b-040b24b9a98f admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:50.533202 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455f158-a3c9-4c6f-ad8b-040b24b9a98f admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:50.538246 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc4687-6bc8-41eb-85ea-f4396394d157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:50.538957 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc4687-6bc8-41eb-85ea-f4396394d157 admin admin] REQUEST_METHOD: `PUT` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:50.539228 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc4687-6bc8-41eb-85ea-f4396394d157 admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:50.539493 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc4687-6bc8-41eb-85ea-f4396394d157 admin admin] PATH_INFO: `/v3/projects/60fbef26bc9341b99035db68441702be/users/055a96b0001e4b8ca0a417671d8f2fd5/roles/e62e78acab6b46f6a866b4980700caae` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:50.541443 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc4687-6bc8-41eb-85ea-f4396394d157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fbef26bc9341b99035db68441702be, user_id=055a96b0001e4b8ca0a417671d8f2fd5, role_id=e62e78acab6b46f6a866b4980700caae)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:50.544134 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc4687-6bc8-41eb-85ea-f4396394d157 admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:50.559089 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 596/1189] 10.222.0.36 () {60 vars in 1483 bytes} [Sat Aug 6 20:47:50 2022] PUT /identity/v3/projects/60fbef26bc9341b99035db68441702be/users/055a96b0001e4b8ca0a417671d8f2fd5/roles/e62e78acab6b46f6a866b4980700caae => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:50.586514 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31d6e4-a844-40a9-b5db-24548e87bea1 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:50.586840 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31d6e4-a844-40a9-b5db-24548e87bea1 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:50.587111 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31d6e4-a844-40a9-b5db-24548e87bea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:50.641867 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-bc31d6e4-a844-40a9-b5db-24548e87bea1 None None] MFA Rules not processed for user `d97ddb5d77f24cf39c29501fede75baf`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:50.643329 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-bc31d6e4-a844-40a9-b5db-24548e87bea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:50.701915 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:50.729185 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 594/1190] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:47:50 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:50.734091 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc4687-6bc8-41eb-85ea-f4396394d157 admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:50.829279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc4687-6bc8-41eb-85ea-f4396394d157 admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:50.834489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d10be3-5c9a-4d8a-98f2-05ad623504e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:50.835246 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d10be3-5c9a-4d8a-98f2-05ad623504e1 admin admin] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:50.835589 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d10be3-5c9a-4d8a-98f2-05ad623504e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:50.835931 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d10be3-5c9a-4d8a-98f2-05ad623504e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:50.836679 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d10be3-5c9a-4d8a-98f2-05ad623504e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:50.838900 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d10be3-5c9a-4d8a-98f2-05ad623504e1 admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:50.878332 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 597/1191] 10.222.0.36 () {60 vars in 1153 bytes} [Sat Aug 6 20:47:50 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:47:50.882429 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31d6e4-a844-40a9-b5db-24548e87bea1 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:50.901257 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31d6e4-a844-40a9-b5db-24548e87bea1 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:50.974322 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78531157-67e7-4746-a748-43bc263ad7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:50.975426 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78531157-67e7-4746-a748-43bc263ad7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:50.975426 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78531157-67e7-4746-a748-43bc263ad7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:50.976119 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78531157-67e7-4746-a748-43bc263ad7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:50.976834 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78531157-67e7-4746-a748-43bc263ad7b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:50.978927 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78531157-67e7-4746-a748-43bc263ad7b7 admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:51.006630 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 595/1192] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Aug 6 20:47:50 2022] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:47:51.010816 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d10be3-5c9a-4d8a-98f2-05ad623504e1 admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:51.022027 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d10be3-5c9a-4d8a-98f2-05ad623504e1 admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:51.027705 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3f5f9-b752-48ad-ab57-d6323cfefb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:51.028525 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3f5f9-b752-48ad-ab57-d6323cfefb9c admin admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:51.028935 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3f5f9-b752-48ad-ab57-d6323cfefb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:51.029935 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3f5f9-b752-48ad-ab57-d6323cfefb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:51.030109 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3f5f9-b752-48ad-ab57-d6323cfefb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:51.031987 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3f5f9-b752-48ad-ab57-d6323cfefb9c admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:51.047593 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 598/1193] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:51.049051 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78531157-67e7-4746-a748-43bc263ad7b7 admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:51.061386 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78531157-67e7-4746-a748-43bc263ad7b7 admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:51.067420 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ab484-4ee9-4a2a-a2fa-d6b2a5e6eedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:51.068186 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ab484-4ee9-4a2a-a2fa-d6b2a5e6eedd admin admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:51.068597 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ab484-4ee9-4a2a-a2fa-d6b2a5e6eedd admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:51.069308 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ab484-4ee9-4a2a-a2fa-d6b2a5e6eedd admin admin] PATH_INFO: `/v3/projects/83e1d4bf851943559afee4eb6ef5a5ef/users/f82f83a4e50b418da1671cf43edae8f7/roles/e62e78acab6b46f6a866b4980700caae` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:51.092395 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ab484-4ee9-4a2a-a2fa-d6b2a5e6eedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e1d4bf851943559afee4eb6ef5a5ef, user_id=f82f83a4e50b418da1671cf43edae8f7, role_id=e62e78acab6b46f6a866b4980700caae)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:51.096156 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ab484-4ee9-4a2a-a2fa-d6b2a5e6eedd admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:51.114038 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 596/1194] 10.222.0.36 () {60 vars in 1483 bytes} [Sat Aug 6 20:47:51 2022] PUT /identity/v3/projects/83e1d4bf851943559afee4eb6ef5a5ef/users/f82f83a4e50b418da1671cf43edae8f7/roles/e62e78acab6b46f6a866b4980700caae => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:51.117981 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3f5f9-b752-48ad-ab57-d6323cfefb9c admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:51.129017 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3f5f9-b752-48ad-ab57-d6323cfefb9c admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:51.198793 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302f49c-dfc3-4d33-93cb-907e1c834d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:51.199583 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302f49c-dfc3-4d33-93cb-907e1c834d68 admin admin] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:51.199863 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302f49c-dfc3-4d33-93cb-907e1c834d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:51.200352 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302f49c-dfc3-4d33-93cb-907e1c834d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:51.201290 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302f49c-dfc3-4d33-93cb-907e1c834d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:51.203419 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302f49c-dfc3-4d33-93cb-907e1c834d68 admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:51.222642 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 599/1195] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:51.224819 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ab484-4ee9-4a2a-a2fa-d6b2a5e6eedd admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:51.253506 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ab484-4ee9-4a2a-a2fa-d6b2a5e6eedd admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:51.266848 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25f68c-2b5e-4fb3-98d7-5f9e8a7cc9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:51.267849 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25f68c-2b5e-4fb3-98d7-5f9e8a7cc9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:51.268385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25f68c-2b5e-4fb3-98d7-5f9e8a7cc9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:51.268885 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25f68c-2b5e-4fb3-98d7-5f9e8a7cc9c4 admin admin] PATH_INFO: `/v3/projects/83e1d4bf851943559afee4eb6ef5a5ef/users/f82f83a4e50b418da1671cf43edae8f7/roles/e62e78acab6b46f6a866b4980700caae` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:51.272159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25f68c-2b5e-4fb3-98d7-5f9e8a7cc9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e1d4bf851943559afee4eb6ef5a5ef, user_id=f82f83a4e50b418da1671cf43edae8f7, role_id=e62e78acab6b46f6a866b4980700caae)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:51.276859 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25f68c-2b5e-4fb3-98d7-5f9e8a7cc9c4 admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:51.299549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 597/1196] 10.222.0.36 () {60 vars in 1483 bytes} [Sat Aug 6 20:47:51 2022] PUT /identity/v3/projects/83e1d4bf851943559afee4eb6ef5a5ef/users/f82f83a4e50b418da1671cf43edae8f7/roles/e62e78acab6b46f6a866b4980700caae => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:56.941049 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957439-4766-4ba9-95cc-e79d1e17722a None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:56.941550 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957439-4766-4ba9-95cc-e79d1e17722a None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:56.941767 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957439-4766-4ba9-95cc-e79d1e17722a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:57.015764 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-d3957439-4766-4ba9-95cc-e79d1e17722a None None] MFA Rules not processed for user `055a96b0001e4b8ca0a417671d8f2fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:57.016522 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-d3957439-4766-4ba9-95cc-e79d1e17722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:57.085596 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:57.174638 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 600/1197] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:47:56 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:57.200585 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25f68c-2b5e-4fb3-98d7-5f9e8a7cc9c4 admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:57.202878 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-9d25f68c-2b5e-4fb3-98d7-5f9e8a7cc9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:57.553182 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25f68c-2b5e-4fb3-98d7-5f9e8a7cc9c4 admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:57.558728 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d550143-ae5e-4777-9711-5d502fb604fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55b636efe4fe483c4905af6ca5115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:57.559556 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d550143-ae5e-4777-9711-5d502fb604fc service glance] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:57.560195 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d550143-ae5e-4777-9711-5d502fb604fc service glance] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:57.561025 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d550143-ae5e-4777-9711-5d502fb604fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:57.608294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:57.635475 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d550143-ae5e-4777-9711-5d502fb604fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:57.636958 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d550143-ae5e-4777-9711-5d502fb604fc service glance] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:57.650129 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 598/1198] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:57 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:57.956786 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa38f6-af08-43cc-a5e8-e50732cf27ad None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:57.957305 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa38f6-af08-43cc-a5e8-e50732cf27ad None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:57.957305 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa38f6-af08-43cc-a5e8-e50732cf27ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:57.993898 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-c7fa38f6-af08-43cc-a5e8-e50732cf27ad None None] MFA Rules not processed for user `f82f83a4e50b418da1671cf43edae8f7`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:57.995207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-c7fa38f6-af08-43cc-a5e8-e50732cf27ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:58.084904 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 601/1199] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:47:57 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:58.092746 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d550143-ae5e-4777-9711-5d502fb604fc service glance] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:58.094730 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-4d550143-ae5e-4777-9711-5d502fb604fc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:58.107391 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d550143-ae5e-4777-9711-5d502fb604fc service glance] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:58.111739 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ffca8-eed3-4b54-8072-b11eeae9a946 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55b636efe4fe483c4905af6ca5115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:58.112588 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ffca8-eed3-4b54-8072-b11eeae9a946 service glance] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:58.112729 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ffca8-eed3-4b54-8072-b11eeae9a946 service glance] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:58.112880 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ffca8-eed3-4b54-8072-b11eeae9a946 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:58.176958 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ffca8-eed3-4b54-8072-b11eeae9a946 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:58.178394 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ffca8-eed3-4b54-8072-b11eeae9a946 service glance] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:58.188255 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 599/1200] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:58 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:06.112981 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b201992-7683-4fad-8777-0b028f5eea23 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:06.113603 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b201992-7683-4fad-8777-0b028f5eea23 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:06.113603 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b201992-7683-4fad-8777-0b028f5eea23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:06.133048 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-0b201992-7683-4fad-8777-0b028f5eea23 None None] MFA Rules not processed for user `d97ddb5d77f24cf39c29501fede75baf`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:06.134234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-0b201992-7683-4fad-8777-0b028f5eea23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:06.141666 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 602/1201] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:48:06 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:06.440454 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854dcb8-b97d-417f-b40e-72adc27e7942 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:06.441159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854dcb8-b97d-417f-b40e-72adc27e7942 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:06.441159 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854dcb8-b97d-417f-b40e-72adc27e7942 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:06.443039 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 600/1202] 10.222.0.36 () {54 vars in 962 bytes} [Sat Aug 6 20:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:48:06.448534 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3103088-f333-4f59-b43c-4d846791f337 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:06.448815 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3103088-f333-4f59-b43c-4d846791f337 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:06.449085 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3103088-f333-4f59-b43c-4d846791f337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:06.482330 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-b3103088-f333-4f59-b43c-4d846791f337 None None] MFA Rules not processed for user `9f24d354e53845b2a847fdd12077fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:06.483512 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-b3103088-f333-4f59-b43c-4d846791f337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:06.566236 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 603/1203] 10.222.0.36 () {58 vars in 1059 bytes} [Sat Aug 6 20:48:06 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:06.571834 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5adac-a2fb-488f-bd13-5fb08bb9d54a None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:06.572244 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5adac-a2fb-488f-bd13-5fb08bb9d54a None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:06.572432 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5adac-a2fb-488f-bd13-5fb08bb9d54a None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:06.573718 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 601/1204] 10.222.0.36 () {54 vars in 912 bytes} [Sat Aug 6 20:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:48:06.579362 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7ea4e-da94-4d98-8a38-1f467d42a45f None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:06.579835 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7ea4e-da94-4d98-8a38-1f467d42a45f None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:06.580289 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7ea4e-da94-4d98-8a38-1f467d42a45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:06.601042 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-bfc7ea4e-da94-4d98-8a38-1f467d42a45f None None] MFA Rules not processed for user `9f24d354e53845b2a847fdd12077fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:06.602248 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-bfc7ea4e-da94-4d98-8a38-1f467d42a45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:06.610967 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 604/1205] 10.222.0.36 () {58 vars in 1009 bytes} [Sat Aug 6 20:48:06 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:06.622657 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5adac-a2fb-488f-bd13-5fb08bb9d54a None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:06.633466 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5adac-a2fb-488f-bd13-5fb08bb9d54a None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:06.637072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a8e45-8fbd-40be-ad63-c45530718c55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55b636efe4fe483c4905af6ca5115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:06.637701 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a8e45-8fbd-40be-ad63-c45530718c55 service glance] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:06.638031 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a8e45-8fbd-40be-ad63-c45530718c55 service glance] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:06.638294 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a8e45-8fbd-40be-ad63-c45530718c55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:06.647686 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a8e45-8fbd-40be-ad63-c45530718c55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:06.649118 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a8e45-8fbd-40be-ad63-c45530718c55 service glance] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:06.659675 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 602/1206] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:06 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:07.119078 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f870314-c6d7-411f-bfe4-5e323d7adfc9 None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.119621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f870314-c6d7-411f-bfe4-5e323d7adfc9 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.119621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f870314-c6d7-411f-bfe4-5e323d7adfc9 None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.120973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 605/1207] 10.222.0.36 () {54 vars in 912 bytes} [Sat Aug 6 20:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:48:07.126413 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e62d7b-4a74-4635-bebf-e33750088109 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.126731 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e62d7b-4a74-4635-bebf-e33750088109 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.127002 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e62d7b-4a74-4635-bebf-e33750088109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.158408 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-a9e62d7b-4a74-4635-bebf-e33750088109 None None] MFA Rules not processed for user `471f571c16f9434e924b3a4589340db4`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:07.159699 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-a9e62d7b-4a74-4635-bebf-e33750088109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:07.210987 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 603/1208] 10.222.0.36 () {58 vars in 1009 bytes} [Sat Aug 6 20:48:07 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:07.223621 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f870314-c6d7-411f-bfe4-5e323d7adfc9 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:07.239934 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f870314-c6d7-411f-bfe4-5e323d7adfc9 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:07.243761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a600d-9ecb-4695-8c27-9f8c1d41a94c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:07.244371 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a600d-9ecb-4695-8c27-9f8c1d41a94c service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.244647 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a600d-9ecb-4695-8c27-9f8c1d41a94c service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.244911 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a600d-9ecb-4695-8c27-9f8c1d41a94c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.258642 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a600d-9ecb-4695-8c27-9f8c1d41a94c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:07.260135 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a600d-9ecb-4695-8c27-9f8c1d41a94c service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:07.268062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 606/1209] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:07 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:07.721461 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc3f1f-7f78-4c84-bb7b-309299726a78 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.721937 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc3f1f-7f78-4c84-bb7b-309299726a78 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.722204 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc3f1f-7f78-4c84-bb7b-309299726a78 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.725725 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 604/1210] 10.222.0.36 () {54 vars in 962 bytes} [Sat Aug 6 20:48:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:48:07.730670 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a5008-5875-4366-bb89-3ab5236f98b1 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.731039 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a5008-5875-4366-bb89-3ab5236f98b1 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.731388 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a5008-5875-4366-bb89-3ab5236f98b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.736951 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b42a3-43f3-4bba-83f5-f8f9ea90a8bc None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.737338 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b42a3-43f3-4bba-83f5-f8f9ea90a8bc None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.737672 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b42a3-43f3-4bba-83f5-f8f9ea90a8bc None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.741545 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 605/1211] 10.222.0.36 () {54 vars in 961 bytes} [Sat Aug 6 20:48:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:48:07.757033 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01c6ef-9153-498d-8973-2ea3143d98ca None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.757307 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01c6ef-9153-498d-8973-2ea3143d98ca None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.757599 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01c6ef-9153-498d-8973-2ea3143d98ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.781510 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-6b3a5008-5875-4366-bb89-3ab5236f98b1 None None] MFA Rules not processed for user `9f24d354e53845b2a847fdd12077fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:07.783221 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-6b3a5008-5875-4366-bb89-3ab5236f98b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:07.783927 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-af01c6ef-9153-498d-8973-2ea3143d98ca None None] MFA Rules not processed for user `47953125a0e64fef8f36c17b3504e9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:07.785081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-af01c6ef-9153-498d-8973-2ea3143d98ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:07.796917 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 607/1212] 10.222.0.36 () {58 vars in 1059 bytes} [Sat Aug 6 20:48:07 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:07.809982 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378ba5b-5f65-4faa-b7c5-6f1455c58a3b None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.810200 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378ba5b-5f65-4faa-b7c5-6f1455c58a3b None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.810553 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378ba5b-5f65-4faa-b7c5-6f1455c58a3b None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.814739 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 608/1213] 10.222.0.36 () {54 vars in 912 bytes} [Sat Aug 6 20:48:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:48:07.818841 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c28ba-c90d-4e8f-aedb-04d1e9496276 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.819322 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c28ba-c90d-4e8f-aedb-04d1e9496276 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.819764 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c28ba-c90d-4e8f-aedb-04d1e9496276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.831549 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=100 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:07.851950 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-c96c28ba-c90d-4e8f-aedb-04d1e9496276 None None] MFA Rules not processed for user `9f24d354e53845b2a847fdd12077fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:07.854160 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-c96c28ba-c90d-4e8f-aedb-04d1e9496276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:07.865287 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 609/1214] 10.222.0.36 () {58 vars in 1009 bytes} [Sat Aug 6 20:48:07 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:48:07.878198 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c28ba-c90d-4e8f-aedb-04d1e9496276 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:07.891237 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c28ba-c90d-4e8f-aedb-04d1e9496276 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:07.899566 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=100 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:07.903618 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aebf15-f5ae-4654-8ae0-2eff4e440830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:07.906108 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aebf15-f5ae-4654-8ae0-2eff4e440830 service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.906393 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aebf15-f5ae-4654-8ae0-2eff4e440830 service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.906698 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aebf15-f5ae-4654-8ae0-2eff4e440830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.923563 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aebf15-f5ae-4654-8ae0-2eff4e440830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:07.927073 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 606/1215] 10.222.0.36 () {58 vars in 1058 bytes} [Sat Aug 6 20:48:07 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:48:07.933103 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01c6ef-9153-498d-8973-2ea3143d98ca None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:07.933855 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aebf15-f5ae-4654-8ae0-2eff4e440830 service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:07.958271 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01c6ef-9153-498d-8973-2ea3143d98ca None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:07.970654 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 610/1216] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:07 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:07.977686 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e9c6b-9b92-4054-b5da-831708eb251c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47953125a0e64fef8f36c17b3504e9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:07.978353 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e9c6b-9b92-4054-b5da-831708eb251c service placement] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.978655 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e9c6b-9b92-4054-b5da-831708eb251c service placement] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.978929 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e9c6b-9b92-4054-b5da-831708eb251c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.983594 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-777e9c6b-9b92-4054-b5da-831708eb251c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:08.016305 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e9c6b-9b92-4054-b5da-831708eb251c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:08.018359 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e9c6b-9b92-4054-b5da-831708eb251c service placement] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:08.038999 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 607/1217] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:07 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:48:17.963919 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=7 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:18.027471 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=7 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:20.755514 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f96dd-e783-4516-ba5c-fda64649f106 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:20.756308 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f96dd-e783-4516-ba5c-fda64649f106 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:20.756308 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f96dd-e783-4516-ba5c-fda64649f106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:20.781002 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-9d0f96dd-e783-4516-ba5c-fda64649f106 None None] MFA Rules not processed for user `471f571c16f9434e924b3a4589340db4`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:20.782205 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-9d0f96dd-e783-4516-ba5c-fda64649f106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:20.790249 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 611/1218] 10.222.0.39 () {58 vars in 1015 bytes} [Sat Aug 6 20:48:20 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:20.802912 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e9c6b-9b92-4054-b5da-831708eb251c service placement] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:20.819841 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e9c6b-9b92-4054-b5da-831708eb251c service placement] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:20.824487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4c2bd-63f9-43dc-8807-67d31640841e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:20.825126 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4c2bd-63f9-43dc-8807-67d31640841e service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:20.825376 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4c2bd-63f9-43dc-8807-67d31640841e service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:20.825706 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4c2bd-63f9-43dc-8807-67d31640841e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:20.837818 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4c2bd-63f9-43dc-8807-67d31640841e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:20.839301 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4c2bd-63f9-43dc-8807-67d31640841e service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:20.848577 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 608/1219] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:20 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:21.671289 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3867aa-a05d-40dc-b769-bc032504eb4c None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:21.671560 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3867aa-a05d-40dc-b769-bc032504eb4c None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:21.671823 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3867aa-a05d-40dc-b769-bc032504eb4c None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:21.673167 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 612/1220] 10.222.0.36 () {54 vars in 921 bytes} [Sat Aug 6 20:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:48:21.728081 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef74387-cf54-4221-ad9d-2016e1a449c1 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:21.728378 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef74387-cf54-4221-ad9d-2016e1a449c1 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:21.728646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef74387-cf54-4221-ad9d-2016e1a449c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:21.749759 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-eef74387-cf54-4221-ad9d-2016e1a449c1 None None] MFA Rules not processed for user `9f24d354e53845b2a847fdd12077fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:21.751017 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-eef74387-cf54-4221-ad9d-2016e1a449c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:21.760970 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 609/1221] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Aug 6 20:48:21 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:21.783710 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3867aa-a05d-40dc-b769-bc032504eb4c None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:21.802365 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3867aa-a05d-40dc-b769-bc032504eb4c None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:21.808918 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b1c31-2d8e-47fb-ac89-3f3a617a80e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:21.809731 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b1c31-2d8e-47fb-ac89-3f3a617a80e0 service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:21.810234 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b1c31-2d8e-47fb-ac89-3f3a617a80e0 service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:21.810695 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b1c31-2d8e-47fb-ac89-3f3a617a80e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:21.820339 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b1c31-2d8e-47fb-ac89-3f3a617a80e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:21.822072 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b1c31-2d8e-47fb-ac89-3f3a617a80e0 service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:21.832793 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 613/1222] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:21 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:28.077120 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755167c-6ed5-4a2c-aebc-8f10ce0ae353 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:28.078147 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755167c-6ed5-4a2c-aebc-8f10ce0ae353 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:28.078780 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755167c-6ed5-4a2c-aebc-8f10ce0ae353 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:28.080189 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 610/1223] 10.222.0.36 () {54 vars in 921 bytes} [Sat Aug 6 20:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:48:28.087273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088827-867a-4f05-9da3-696d55d01171 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:28.087273 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088827-867a-4f05-9da3-696d55d01171 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:28.087903 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088827-867a-4f05-9da3-696d55d01171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:28.110510 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-1b088827-867a-4f05-9da3-696d55d01171 None None] MFA Rules not processed for user `9f24d354e53845b2a847fdd12077fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:28.111973 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-1b088827-867a-4f05-9da3-696d55d01171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:28.122687 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 614/1224] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Aug 6 20:48:28 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:28.138145 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755167c-6ed5-4a2c-aebc-8f10ce0ae353 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:28.153721 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755167c-6ed5-4a2c-aebc-8f10ce0ae353 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:28.158678 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f488bda-458b-41ee-b3c8-90a2163c342c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:28.159328 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f488bda-458b-41ee-b3c8-90a2163c342c service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:28.159609 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f488bda-458b-41ee-b3c8-90a2163c342c service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:28.159876 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f488bda-458b-41ee-b3c8-90a2163c342c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:28.169189 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f488bda-458b-41ee-b3c8-90a2163c342c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:28.170850 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f488bda-458b-41ee-b3c8-90a2163c342c service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:28.184128 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 611/1225] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:28 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:38.105597 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=12 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:38.177635 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=15 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:40.661900 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088827-867a-4f05-9da3-696d55d01171 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:40.671603 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088827-867a-4f05-9da3-696d55d01171 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:40.675338 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103994ea-1d39-4a7f-b54b-f7d5ff09b9c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:40.676000 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103994ea-1d39-4a7f-b54b-f7d5ff09b9c0 service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:40.676279 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103994ea-1d39-4a7f-b54b-f7d5ff09b9c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:40.676546 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103994ea-1d39-4a7f-b54b-f7d5ff09b9c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:40.685622 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103994ea-1d39-4a7f-b54b-f7d5ff09b9c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:40.687129 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103994ea-1d39-4a7f-b54b-f7d5ff09b9c0 service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:40.697900 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 615/1226] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:40 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:50.693010 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=6 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:56.686523 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612a922-1686-4c40-8e12-47c45ea785e2 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:56.687135 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612a922-1686-4c40-8e12-47c45ea785e2 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:56.687135 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612a922-1686-4c40-8e12-47c45ea785e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:56.706287 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-a612a922-1686-4c40-8e12-47c45ea785e2 None None] MFA Rules not processed for user `2416219e665d4648b8505cb1147e721c`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:56.707490 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-a612a922-1686-4c40-8e12-47c45ea785e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:56.715126 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 612/1227] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:48:56 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:06.701620 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=3 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:26.004114 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5edabc-f051-4ad0-8fe7-b47d61bd5521 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:26.004684 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5edabc-f051-4ad0-8fe7-b47d61bd5521 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:26.004684 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5edabc-f051-4ad0-8fe7-b47d61bd5521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:26.025984 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-6c5edabc-f051-4ad0-8fe7-b47d61bd5521 None None] MFA Rules not processed for user `2416219e665d4648b8505cb1147e721c`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:26.027203 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-6c5edabc-f051-4ad0-8fe7-b47d61bd5521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:26.038355 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 616/1228] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:49:26 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:26.347947 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595173-e49d-47a4-a9b2-5ca99e704195 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:26.348421 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595173-e49d-47a4-a9b2-5ca99e704195 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:26.348502 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595173-e49d-47a4-a9b2-5ca99e704195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:26.370447 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-64595173-e49d-47a4-a9b2-5ca99e704195 None None] MFA Rules not processed for user `471f571c16f9434e924b3a4589340db4`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:26.371666 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-64595173-e49d-47a4-a9b2-5ca99e704195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:26.378789 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 613/1229] 10.222.0.36 () {58 vars in 1009 bytes} [Sat Aug 6 20:49:26 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:26.392016 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5edabc-f051-4ad0-8fe7-b47d61bd5521 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:26.404564 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5edabc-f051-4ad0-8fe7-b47d61bd5521 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:26.409283 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0312d9c-87cf-48c9-997d-bbb20e1b76fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:26.409884 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0312d9c-87cf-48c9-997d-bbb20e1b76fa service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:26.410155 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0312d9c-87cf-48c9-997d-bbb20e1b76fa service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:26.410416 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0312d9c-87cf-48c9-997d-bbb20e1b76fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:26.418480 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0312d9c-87cf-48c9-997d-bbb20e1b76fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:26.419938 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0312d9c-87cf-48c9-997d-bbb20e1b76fa service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:26.428290 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 617/1230] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:26 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:36.365264 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=3 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:36.424352 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=9 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:41.097246 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ceef4-69dc-4bfe-99f1-58ca56cbf136 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:41.097733 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ceef4-69dc-4bfe-99f1-58ca56cbf136 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:41.098201 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ceef4-69dc-4bfe-99f1-58ca56cbf136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:41.120612 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-cb4ceef4-69dc-4bfe-99f1-58ca56cbf136 None None] MFA Rules not processed for user `2416219e665d4648b8505cb1147e721c`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:41.122186 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-cb4ceef4-69dc-4bfe-99f1-58ca56cbf136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:41.129754 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 614/1231] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:49:41 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:51.114296 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=3 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:41.628790 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed876f-0046-4587-b77f-c877b9c65a79 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:41.629346 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed876f-0046-4587-b77f-c877b9c65a79 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:41.629346 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed876f-0046-4587-b77f-c877b9c65a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:41.648707 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-9aed876f-0046-4587-b77f-c877b9c65a79 None None] MFA Rules not processed for user `2416219e665d4648b8505cb1147e721c`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:50:41.650015 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-9aed876f-0046-4587-b77f-c877b9c65a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:41.658184 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 618/1232] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:50:41 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:50:51.643952 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=3 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:55.989539 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ceef4-69dc-4bfe-99f1-58ca56cbf136 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:56.008946 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ceef4-69dc-4bfe-99f1-58ca56cbf136 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:56.013069 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb1e91-c70e-4173-ab42-8c84eccd69db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:56.013694 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb1e91-c70e-4173-ab42-8c84eccd69db service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:56.013968 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb1e91-c70e-4173-ab42-8c84eccd69db service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:56.014197 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb1e91-c70e-4173-ab42-8c84eccd69db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:56.024023 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb1e91-c70e-4173-ab42-8c84eccd69db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:56.025447 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb1e91-c70e-4173-ab42-8c84eccd69db service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:56.035109 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 615/1233] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:50:55 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:51:06.030799 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=10 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:00.913218 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed876f-0046-4587-b77f-c877b9c65a79 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:00.938523 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed876f-0046-4587-b77f-c877b9c65a79 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:00.944189 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee42510-d2e9-47da-946e-a1a5e014ae4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47953125a0e64fef8f36c17b3504e9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:00.944798 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee42510-d2e9-47da-946e-a1a5e014ae4a service placement] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:00.945070 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee42510-d2e9-47da-946e-a1a5e014ae4a service placement] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:00.945338 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee42510-d2e9-47da-946e-a1a5e014ae4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:00.953943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee42510-d2e9-47da-946e-a1a5e014ae4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:00.955567 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee42510-d2e9-47da-946e-a1a5e014ae4a service placement] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:00.965439 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 619/1234] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:52:00 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:52:10.961717 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=10 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:03.672212 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb1e91-c70e-4173-ab42-8c84eccd69db service neutron] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:03.693535 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb1e91-c70e-4173-ab42-8c84eccd69db service neutron] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:03.699260 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53d6d4-5bd9-4bb5-8256-e730a8ea45d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:03.699861 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53d6d4-5bd9-4bb5-8256-e730a8ea45d6 service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:03.700141 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53d6d4-5bd9-4bb5-8256-e730a8ea45d6 service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:03.700400 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53d6d4-5bd9-4bb5-8256-e730a8ea45d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:03.708790 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53d6d4-5bd9-4bb5-8256-e730a8ea45d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:03.710361 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53d6d4-5bd9-4bb5-8256-e730a8ea45d6 service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:03.719931 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 616/1235] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:03 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:06.295506 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee42510-d2e9-47da-946e-a1a5e014ae4a service placement] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:06.305337 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee42510-d2e9-47da-946e-a1a5e014ae4a service placement] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:06.309137 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80174453-6fef-4e89-929b-b7fba574a95a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:06.309763 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80174453-6fef-4e89-929b-b7fba574a95a service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:06.310034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80174453-6fef-4e89-929b-b7fba574a95a service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:06.310298 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80174453-6fef-4e89-929b-b7fba574a95a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:06.320655 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80174453-6fef-4e89-929b-b7fba574a95a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:06.322097 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80174453-6fef-4e89-929b-b7fba574a95a service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:06.332882 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 620/1236] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:06 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:07.580633 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3452a85-6903-4734-a0c4-ad16b9296e73 None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:07.581072 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3452a85-6903-4734-a0c4-ad16b9296e73 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:07.581177 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3452a85-6903-4734-a0c4-ad16b9296e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:07.601737 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-b3452a85-6903-4734-a0c4-ad16b9296e73 None None] MFA Rules not processed for user `2416219e665d4648b8505cb1147e721c`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:07.602985 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-b3452a85-6903-4734-a0c4-ad16b9296e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:07.609838 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 617/1237] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:53:07 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:53:07.896757 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80174453-6fef-4e89-929b-b7fba574a95a service neutron] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:07.905537 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80174453-6fef-4e89-929b-b7fba574a95a service neutron] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:07.909495 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44643f-50aa-4b30-b143-6b7d293cfff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:07.910100 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44643f-50aa-4b30-b143-6b7d293cfff0 service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:07.910376 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44643f-50aa-4b30-b143-6b7d293cfff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:07.910668 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44643f-50aa-4b30-b143-6b7d293cfff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:07.922006 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44643f-50aa-4b30-b143-6b7d293cfff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:07.923359 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44643f-50aa-4b30-b143-6b7d293cfff0 service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:07.933974 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 621/1238] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:07 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:08.471074 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3452a85-6903-4734-a0c4-ad16b9296e73 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:08.484078 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3452a85-6903-4734-a0c4-ad16b9296e73 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:08.490139 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5491a-2298-4e9d-ad75-ea865c451c33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47953125a0e64fef8f36c17b3504e9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:08.490885 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5491a-2298-4e9d-ad75-ea865c451c33 service placement] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:08.491220 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5491a-2298-4e9d-ad75-ea865c451c33 service placement] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:08.491487 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5491a-2298-4e9d-ad75-ea865c451c33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:08.500722 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5491a-2298-4e9d-ad75-ea865c451c33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:08.502279 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5491a-2298-4e9d-ad75-ea865c451c33 service placement] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:08.512672 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 618/1239] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:08 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:17.057547 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44643f-50aa-4b30-b143-6b7d293cfff0 service neutron] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:17.068264 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44643f-50aa-4b30-b143-6b7d293cfff0 service neutron] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:17.074489 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f11ac-9ac8-4dc5-9d1f-73cba1e15c00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:17.075110 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f11ac-9ac8-4dc5-9d1f-73cba1e15c00 service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:17.075392 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f11ac-9ac8-4dc5-9d1f-73cba1e15c00 service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:17.075647 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f11ac-9ac8-4dc5-9d1f-73cba1e15c00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:17.083747 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f11ac-9ac8-4dc5-9d1f-73cba1e15c00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:17.085737 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f11ac-9ac8-4dc5-9d1f-73cba1e15c00 service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:17.094841 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 622/1240] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:17 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:18.508566 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=19 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:18.915753 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdeda09-7979-4c09-9ed3-474bd7057dee None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:18.916328 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdeda09-7979-4c09-9ed3-474bd7057dee None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:18.916828 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdeda09-7979-4c09-9ed3-474bd7057dee None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:18.918521 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 619/1241] 10.222.0.36 () {54 vars in 921 bytes} [Sat Aug 6 20:53:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:53:18.924484 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc4dce-7d27-48ef-8aee-d0a9be83c146 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:18.924978 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc4dce-7d27-48ef-8aee-d0a9be83c146 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:18.925367 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc4dce-7d27-48ef-8aee-d0a9be83c146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:18.996923 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-6ffc4dce-7d27-48ef-8aee-d0a9be83c146 None None] MFA Rules not processed for user `9f24d354e53845b2a847fdd12077fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:18.999067 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-6ffc4dce-7d27-48ef-8aee-d0a9be83c146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:19.009954 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 623/1242] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Aug 6 20:53:18 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:19.025280 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdeda09-7979-4c09-9ed3-474bd7057dee None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:19.039783 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdeda09-7979-4c09-9ed3-474bd7057dee None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:19.045023 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1cde6-8314-4f9c-9b03-56e1feb61af7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:19.045646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1cde6-8314-4f9c-9b03-56e1feb61af7 service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:19.045914 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1cde6-8314-4f9c-9b03-56e1feb61af7 service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:19.046180 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1cde6-8314-4f9c-9b03-56e1feb61af7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:19.055241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1cde6-8314-4f9c-9b03-56e1feb61af7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:19.056845 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1cde6-8314-4f9c-9b03-56e1feb61af7 service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:19.067638 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 620/1243] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:19 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:22.751019 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc4dce-7d27-48ef-8aee-d0a9be83c146 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:22.761934 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc4dce-7d27-48ef-8aee-d0a9be83c146 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:22.766292 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1c508-e90d-4774-89e1-8681c2f0572b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:22.767255 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1c508-e90d-4774-89e1-8681c2f0572b service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:22.767850 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1c508-e90d-4774-89e1-8681c2f0572b service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:22.768228 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1c508-e90d-4774-89e1-8681c2f0572b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:22.778437 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1c508-e90d-4774-89e1-8681c2f0572b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:22.780042 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1c508-e90d-4774-89e1-8681c2f0572b service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:22.789423 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 624/1244] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:22 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:25.365823 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1cde6-8314-4f9c-9b03-56e1feb61af7 service nova] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:25.377403 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1cde6-8314-4f9c-9b03-56e1feb61af7 service nova] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:25.384400 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fe1cc-1b42-4d65-a617-c9dd1441443f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:25.385051 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fe1cc-1b42-4d65-a617-c9dd1441443f service nova] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:25.385307 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fe1cc-1b42-4d65-a617-c9dd1441443f service nova] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:25.385598 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fe1cc-1b42-4d65-a617-c9dd1441443f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:25.395605 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fe1cc-1b42-4d65-a617-c9dd1441443f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:25.397323 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fe1cc-1b42-4d65-a617-c9dd1441443f service nova] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:25.409218 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 621/1245] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:25 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:32.785394 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=37 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:33.834076 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161fb0f-d87b-455b-b748-e09acb846d56 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:33.834865 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161fb0f-d87b-455b-b748-e09acb846d56 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:33.834865 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161fb0f-d87b-455b-b748-e09acb846d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:33.854289 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-e161fb0f-d87b-455b-b748-e09acb846d56 None None] MFA Rules not processed for user `d97ddb5d77f24cf39c29501fede75baf`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:33.855508 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-e161fb0f-d87b-455b-b748-e09acb846d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:33.863252 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 625/1246] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:53:33 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:34.359419 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fe1cc-1b42-4d65-a617-c9dd1441443f service nova] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:34.368875 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fe1cc-1b42-4d65-a617-c9dd1441443f service nova] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:34.372691 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8ea3f-1468-4a95-a597-c0895c456d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:34.373278 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8ea3f-1468-4a95-a597-c0895c456d9e service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:34.373543 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8ea3f-1468-4a95-a597-c0895c456d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:34.373808 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8ea3f-1468-4a95-a597-c0895c456d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:34.381162 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8ea3f-1468-4a95-a597-c0895c456d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:34.382646 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8ea3f-1468-4a95-a597-c0895c456d9e service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:34.390549 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 622/1247] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:34 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:43.849449 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=3 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:44.387153 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=18 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:53.509571 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161fb0f-d87b-455b-b748-e09acb846d56 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:53.524034 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161fb0f-d87b-455b-b748-e09acb846d56 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:53.529744 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf046d81-5dea-4751-be8c-93c6b6472c33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f24d354e53845b2a847fdd12077fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:53.530354 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf046d81-5dea-4751-be8c-93c6b6472c33 service nova] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:53.530652 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf046d81-5dea-4751-be8c-93c6b6472c33 service nova] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:53.530920 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf046d81-5dea-4751-be8c-93c6b6472c33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:53.540271 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf046d81-5dea-4751-be8c-93c6b6472c33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:53.541865 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf046d81-5dea-4751-be8c-93c6b6472c33 service nova] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:53.552361 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 626/1248] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:53 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:02.287472 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8ea3f-1468-4a95-a597-c0895c456d9e service neutron] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:02.301948 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8ea3f-1468-4a95-a597-c0895c456d9e service neutron] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:02.307158 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd767f10-ac91-412f-af46-0dcb856acb89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:02.307759 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd767f10-ac91-412f-af46-0dcb856acb89 service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:02.308036 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd767f10-ac91-412f-af46-0dcb856acb89 service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:02.308300 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd767f10-ac91-412f-af46-0dcb856acb89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:02.318476 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd767f10-ac91-412f-af46-0dcb856acb89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:02.320083 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd767f10-ac91-412f-af46-0dcb856acb89 service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:02.330018 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 623/1249] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:02 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:03.548050 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=6 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:12.325639 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=6 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:06.318152 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c54510-0467-4b40-ac74-7bde620d4d60 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:06.318732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c54510-0467-4b40-ac74-7bde620d4d60 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:06.318732 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c54510-0467-4b40-ac74-7bde620d4d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:06.338466 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-a4c54510-0467-4b40-ac74-7bde620d4d60 None None] MFA Rules not processed for user `2416219e665d4648b8505cb1147e721c`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:06.339699 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-a4c54510-0467-4b40-ac74-7bde620d4d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:06.348115 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 627/1250] 10.222.0.36 () {58 vars in 958 bytes} [Sat Aug 6 20:55:06 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:55:06.699516 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd767f10-ac91-412f-af46-0dcb856acb89 service neutron] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:06.709502 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd767f10-ac91-412f-af46-0dcb856acb89 service neutron] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:06.714147 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b20d99-005b-467c-92e1-16d020d77a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:06.714801 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b20d99-005b-467c-92e1-16d020d77a80 service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:06.715078 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b20d99-005b-467c-92e1-16d020d77a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:06.715346 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b20d99-005b-467c-92e1-16d020d77a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:06.723642 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b20d99-005b-467c-92e1-16d020d77a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:06.725070 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b20d99-005b-467c-92e1-16d020d77a80 service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:06.734076 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 624/1251] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:06 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:16.333551 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=3 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:16.730006 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=6 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:47.165861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c54510-0467-4b40-ac74-7bde620d4d60 None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:47.167499 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-a4c54510-0467-4b40-ac74-7bde620d4d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:47.211684 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c54510-0467-4b40-ac74-7bde620d4d60 None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:47.216150 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ad6a4-2ec3-47c0-bacc-9454b154fe9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:47.216760 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ad6a4-2ec3-47c0-bacc-9454b154fe9d service neutron] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:47.217350 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ad6a4-2ec3-47c0-bacc-9454b154fe9d service neutron] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:47.217618 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ad6a4-2ec3-47c0-bacc-9454b154fe9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:47.317217 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ad6a4-2ec3-47c0-bacc-9454b154fe9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:47.319492 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ad6a4-2ec3-47c0-bacc-9454b154fe9d service neutron] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:47.340428 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 628/1252] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:56:50.585792 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c679c-bc12-45ca-a2a3-433546c699e2 None None] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:50.585792 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c679c-bc12-45ca-a2a3-433546c699e2 None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:50.585792 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c679c-bc12-45ca-a2a3-433546c699e2 None None] PATH_INFO: `/` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:50.587324 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 625/1253] 10.222.0.36 () {54 vars in 921 bytes} [Sat Aug 6 20:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:56:50.782898 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e74e7-4c8d-4df9-97bd-0b92cbceebd5 None None] REQUEST_METHOD: `POST` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:50.783444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e74e7-4c8d-4df9-97bd-0b92cbceebd5 None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:50.783444 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e74e7-4c8d-4df9-97bd-0b92cbceebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:50.860144 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.auth.core [None req-9e8e74e7-4c8d-4df9-97bd-0b92cbceebd5 None None] MFA Rules not processed for user `47953125a0e64fef8f36c17b3504e9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:50.861452 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-9e8e74e7-4c8d-4df9-97bd-0b92cbceebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:50.870477 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 629/1254] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Aug 6 20:56:50 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:50.882014 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c679c-bc12-45ca-a2a3-433546c699e2 None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:50.895830 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c679c-bc12-45ca-a2a3-433546c699e2 None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:50.900623 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b886c33-dfab-4e90-97d2-d08ad79d224c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47953125a0e64fef8f36c17b3504e9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:50.901245 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b886c33-dfab-4e90-97d2-d08ad79d224c service placement] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:50.901521 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b886c33-dfab-4e90-97d2-d08ad79d224c service placement] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:50.901783 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b886c33-dfab-4e90-97d2-d08ad79d224c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:50.911640 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b886c33-dfab-4e90-97d2-d08ad79d224c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:50.913241 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b886c33-dfab-4e90-97d2-d08ad79d224c service placement] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:50.926059 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 626/1255] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:50 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:56:54.362307 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3f111-5681-4d93-b8f4-9ee16989fd3d None None] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:54.362890 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3f111-5681-4d93-b8f4-9ee16989fd3d None None] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:54.362890 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3f111-5681-4d93-b8f4-9ee16989fd3d None None] PATH_INFO: `/` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:54.364217 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 630/1256] 10.222.0.36 () {54 vars in 921 bytes} [Sat Aug 6 20:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:56:54.391751 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da35b6-4ee7-4bc0-82f2-a4f385801b5b None None] REQUEST_METHOD: `POST` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:54.392208 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da35b6-4ee7-4bc0-82f2-a4f385801b5b None None] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:54.392389 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da35b6-4ee7-4bc0-82f2-a4f385801b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:54.413310 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.auth.core [None req-d1da35b6-4ee7-4bc0-82f2-a4f385801b5b None None] MFA Rules not processed for user `47953125a0e64fef8f36c17b3504e9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=93752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:54.415132 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-d1da35b6-4ee7-4bc0-82f2-a4f385801b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:54.425402 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 627/1257] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Aug 6 20:56:54 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:54.434335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3f111-5681-4d93-b8f4-9ee16989fd3d None None] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:54.448942 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3f111-5681-4d93-b8f4-9ee16989fd3d None None] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:54.454268 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da35b6-4ee7-4bc0-82f2-a4f385801b5b None None] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:54.455044 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007f5e6-466c-4062-82ad-d778948cb1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:54.455676 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007f5e6-466c-4062-82ad-d778948cb1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:54.455943 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007f5e6-466c-4062-82ad-d778948cb1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:54.456205 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007f5e6-466c-4062-82ad-d778948cb1a6 admin admin] PATH_INFO: `/v3/users/d97ddb5d77f24cf39c29501fede75baf` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:54.457434 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007f5e6-466c-4062-82ad-d778948cb1a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97ddb5d77f24cf39c29501fede75baf)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:54.458500 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: WARNING py.warnings [None req-b007f5e6-466c-4062-82ad-d778948cb1a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:56:54.458500 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: warnings.warn(msg) Aug 06 20:56:54.458500 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: Aug 06 20:56:54.459756 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007f5e6-466c-4062-82ad-d778948cb1a6 admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:54.465995 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da35b6-4ee7-4bc0-82f2-a4f385801b5b None None] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:54.476184 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f75102-8afb-4cc7-b28f-dab3a4733257 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47953125a0e64fef8f36c17b3504e9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:54.476730 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f75102-8afb-4cc7-b28f-dab3a4733257 service placement] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:54.476997 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f75102-8afb-4cc7-b28f-dab3a4733257 service placement] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:54.477259 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f75102-8afb-4cc7-b28f-dab3a4733257 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:54.486388 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f75102-8afb-4cc7-b28f-dab3a4733257 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:54.487950 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f75102-8afb-4cc7-b28f-dab3a4733257 service placement] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:54.497974 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 628/1258] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:54 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:56:54.523320 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:54.527071 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-b007f5e6-466c-4062-82ad-d778948cb1a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97ddb5d77f24cf39c29501fede75baf'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:54.537745 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-b007f5e6-466c-4062-82ad-d778948cb1a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97ddb5d77f24cf39c29501fede75baf'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:54.548675 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-b007f5e6-466c-4062-82ad-d778948cb1a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97ddb5d77f24cf39c29501fede75baf'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:54.566450 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-b007f5e6-466c-4062-82ad-d778948cb1a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97ddb5d77f24cf39c29501fede75baf'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:54.567207 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-b007f5e6-466c-4062-82ad-d778948cb1a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97ddb5d77f24cf39c29501fede75baf'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:54.573173 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 631/1259] 10.222.0.36 () {58 vars in 1224 bytes} [Sat Aug 6 20:56:54 2022] DELETE /identity/v3/users/d97ddb5d77f24cf39c29501fede75baf => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:54.758911 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f75102-8afb-4cc7-b28f-dab3a4733257 service placement] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:54.771119 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f75102-8afb-4cc7-b28f-dab3a4733257 service placement] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:54.828415 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:54.829039 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:54.829310 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:54.829573 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] PATH_INFO: `/v3/projects/e3c67bd59ef1469ab9a2015f1987d6f3` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:54.830683 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c67bd59ef1469ab9a2015f1987d6f3)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:54.831690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: WARNING py.warnings [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:56:54.831690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: warnings.warn(msg) Aug 06 20:56:54.831690 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: Aug 06 20:56:54.832860 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:54.898385 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c67bd59ef1469ab9a2015f1987d6f3', 'request_id': 'req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:54.909571 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c67bd59ef1469ab9a2015f1987d6f3', 'request_id': 'req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:54.926651 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c67bd59ef1469ab9a2015f1987d6f3', 'request_id': 'req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:54.952284 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] The token cache is being invalidate because project e3c67bd59ef1469ab9a2015f1987d6f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:56:54.952583 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:54.953226 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:54.954773 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 629/1260] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:54 2022] DELETE /identity/v3/projects/e3c67bd59ef1469ab9a2015f1987d6f3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:54.959536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007f5e6-466c-4062-82ad-d778948cb1a6 admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:54.961062 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-b007f5e6-466c-4062-82ad-d778948cb1a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:54.975555 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007f5e6-466c-4062-82ad-d778948cb1a6 admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:55.037335 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a278de-fcca-4a53-9513-4b43fd9fd14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:55.037893 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a278de-fcca-4a53-9513-4b43fd9fd14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:55.038162 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a278de-fcca-4a53-9513-4b43fd9fd14e admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:55.038420 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a278de-fcca-4a53-9513-4b43fd9fd14e admin admin] PATH_INFO: `/v3/users/f82f83a4e50b418da1671cf43edae8f7` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:55.039671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a278de-fcca-4a53-9513-4b43fd9fd14e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82f83a4e50b418da1671cf43edae8f7)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:55.041702 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a278de-fcca-4a53-9513-4b43fd9fd14e admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:55.094552 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-c7a278de-fcca-4a53-9513-4b43fd9fd14e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82f83a4e50b418da1671cf43edae8f7'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:55.103059 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-c7a278de-fcca-4a53-9513-4b43fd9fd14e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82f83a4e50b418da1671cf43edae8f7'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:55.110130 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-c7a278de-fcca-4a53-9513-4b43fd9fd14e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82f83a4e50b418da1671cf43edae8f7'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:55.121814 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-c7a278de-fcca-4a53-9513-4b43fd9fd14e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82f83a4e50b418da1671cf43edae8f7'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:55.122713 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-c7a278de-fcca-4a53-9513-4b43fd9fd14e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82f83a4e50b418da1671cf43edae8f7'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:55.129223 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 632/1261] 10.222.0.36 () {58 vars in 1224 bytes} [Sat Aug 6 20:56:54 2022] DELETE /identity/v3/users/f82f83a4e50b418da1671cf43edae8f7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:55.319468 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:55.321643 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:55.343724 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ee0c7-4f0f-416b-91b4-b4ffe14ea610 admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:55.397423 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:55.413148 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:55.413791 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:55.414067 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:55.414334 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b admin admin] PATH_INFO: `/v3/projects/83e1d4bf851943559afee4eb6ef5a5ef` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:55.415505 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83e1d4bf851943559afee4eb6ef5a5ef)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:55.417396 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:55.468196 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83e1d4bf851943559afee4eb6ef5a5ef', 'request_id': 'req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:55.478160 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83e1d4bf851943559afee4eb6ef5a5ef', 'request_id': 'req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:55.485949 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83e1d4bf851943559afee4eb6ef5a5ef', 'request_id': 'req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:55.496774 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b admin admin] The token cache is being invalidate because project 83e1d4bf851943559afee4eb6ef5a5ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:56:55.497074 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:55.497772 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:55.499373 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 630/1262] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:55 2022] DELETE /identity/v3/projects/83e1d4bf851943559afee4eb6ef5a5ef => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:03.294517 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a278de-fcca-4a53-9513-4b43fd9fd14e admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:03.296798 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-c7a278de-fcca-4a53-9513-4b43fd9fd14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:03.346324 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:03.376334 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a278de-fcca-4a53-9513-4b43fd9fd14e admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:03.438753 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d4e01-26d0-4cac-b495-8d1fa91379e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47953125a0e64fef8f36c17b3504e9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:03.439368 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d4e01-26d0-4cac-b495-8d1fa91379e5 service placement] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:03.439637 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d4e01-26d0-4cac-b495-8d1fa91379e5 service placement] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:03.439897 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d4e01-26d0-4cac-b495-8d1fa91379e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:03.441601 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-e27d4e01-26d0-4cac-b495-8d1fa91379e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:03.453021 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d4e01-26d0-4cac-b495-8d1fa91379e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:03.454609 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d4e01-26d0-4cac-b495-8d1fa91379e5 service placement] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:03.465369 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 633/1263] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:03 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:05.493530 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:13.460131 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=40 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:43.002486 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:43.004697 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:43.077842 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f41111-eeb9-4c45-8b9c-17cfc673c65b admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:43.081834 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48c061-cc17-431a-9cf5-6bf07c0f2353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '471f571c16f9434e924b3a4589340db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:43.082437 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48c061-cc17-431a-9cf5-6bf07c0f2353 service neutron] REQUEST_METHOD: `GET` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:43.082769 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48c061-cc17-431a-9cf5-6bf07c0f2353 service neutron] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:43.083003 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48c061-cc17-431a-9cf5-6bf07c0f2353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:43.084943 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-9d48c061-cc17-431a-9cf5-6bf07c0f2353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:43.155183 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48c061-cc17-431a-9cf5-6bf07c0f2353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:43.156631 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48c061-cc17-431a-9cf5-6bf07c0f2353 service neutron] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:43.167026 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 631/1264] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:49.692358 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d4e01-26d0-4cac-b495-8d1fa91379e5 service placement] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:49.693887 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-e27d4e01-26d0-4cac-b495-8d1fa91379e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:49.707545 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d4e01-26d0-4cac-b495-8d1fa91379e5 service placement] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:49.712536 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f10a05-8238-4aa5-a928-0372e936a6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:49.713167 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f10a05-8238-4aa5-a928-0372e936a6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:49.713438 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f10a05-8238-4aa5-a928-0372e936a6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:49.713704 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f10a05-8238-4aa5-a928-0372e936a6c4 admin admin] PATH_INFO: `/v3/users/2416219e665d4648b8505cb1147e721c` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:49.728788 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f10a05-8238-4aa5-a928-0372e936a6c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2416219e665d4648b8505cb1147e721c)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:49.730770 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f10a05-8238-4aa5-a928-0372e936a6c4 admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:49.779007 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-a9f10a05-8238-4aa5-a928-0372e936a6c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2416219e665d4648b8505cb1147e721c'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:49.788218 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-a9f10a05-8238-4aa5-a928-0372e936a6c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2416219e665d4648b8505cb1147e721c'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:49.795510 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-a9f10a05-8238-4aa5-a928-0372e936a6c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2416219e665d4648b8505cb1147e721c'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:49.806968 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-a9f10a05-8238-4aa5-a928-0372e936a6c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2416219e665d4648b8505cb1147e721c'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:49.807671 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-a9f10a05-8238-4aa5-a928-0372e936a6c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2416219e665d4648b8505cb1147e721c'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:49.813871 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 634/1265] 10.222.0.36 () {58 vars in 1224 bytes} [Sat Aug 6 20:57:49 2022] DELETE /identity/v3/users/2416219e665d4648b8505cb1147e721c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:50.012023 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48c061-cc17-431a-9cf5-6bf07c0f2353 service neutron] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:50.022434 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48c061-cc17-431a-9cf5-6bf07c0f2353 service neutron] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:50.082076 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d8687-a620-485f-96bb-b179b27f4688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:50.082737 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d8687-a620-485f-96bb-b179b27f4688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:50.083011 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d8687-a620-485f-96bb-b179b27f4688 admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:50.083279 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d8687-a620-485f-96bb-b179b27f4688 admin admin] PATH_INFO: `/v3/projects/f568ffc0725b48598742afd2a14785ea` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:50.094135 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d8687-a620-485f-96bb-b179b27f4688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f568ffc0725b48598742afd2a14785ea)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:50.096064 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d8687-a620-485f-96bb-b179b27f4688 admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:50.142901 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:50.147085 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-b12d8687-a620-485f-96bb-b179b27f4688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f568ffc0725b48598742afd2a14785ea', 'request_id': 'req-b12d8687-a620-485f-96bb-b179b27f4688'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:50.156316 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-b12d8687-a620-485f-96bb-b179b27f4688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f568ffc0725b48598742afd2a14785ea', 'request_id': 'req-b12d8687-a620-485f-96bb-b179b27f4688'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:50.163070 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-b12d8687-a620-485f-96bb-b179b27f4688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f568ffc0725b48598742afd2a14785ea', 'request_id': 'req-b12d8687-a620-485f-96bb-b179b27f4688'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:50.173846 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-b12d8687-a620-485f-96bb-b179b27f4688 admin admin] The token cache is being invalidate because project f568ffc0725b48598742afd2a14785ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:57:50.174062 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-b12d8687-a620-485f-96bb-b179b27f4688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:50.174711 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-b12d8687-a620-485f-96bb-b179b27f4688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:50.176329 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 632/1266] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Aug 6 20:57:50 2022] DELETE /identity/v3/projects/f568ffc0725b48598742afd2a14785ea => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:50.180697 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f10a05-8238-4aa5-a928-0372e936a6c4 admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:50.182328 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-a9f10a05-8238-4aa5-a928-0372e936a6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:50.196772 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f10a05-8238-4aa5-a928-0372e936a6c4 admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:50.258871 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56333afc-2ac8-4d6a-b131-9fd0b1f2437b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:50.259518 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56333afc-2ac8-4d6a-b131-9fd0b1f2437b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:50.259789 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56333afc-2ac8-4d6a-b131-9fd0b1f2437b admin admin] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:50.260058 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56333afc-2ac8-4d6a-b131-9fd0b1f2437b admin admin] PATH_INFO: `/v3/users/055a96b0001e4b8ca0a417671d8f2fd5` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:50.261182 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56333afc-2ac8-4d6a-b131-9fd0b1f2437b admin admin] RBAC: Authorizing `identity:delete_user(user_id=055a96b0001e4b8ca0a417671d8f2fd5)` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:50.263242 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56333afc-2ac8-4d6a-b131-9fd0b1f2437b admin admin] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:50.323433 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-56333afc-2ac8-4d6a-b131-9fd0b1f2437b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055a96b0001e4b8ca0a417671d8f2fd5'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:50.332516 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-56333afc-2ac8-4d6a-b131-9fd0b1f2437b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055a96b0001e4b8ca0a417671d8f2fd5'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:50.339214 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-56333afc-2ac8-4d6a-b131-9fd0b1f2437b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055a96b0001e4b8ca0a417671d8f2fd5'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:50.340272 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:50.353457 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-56333afc-2ac8-4d6a-b131-9fd0b1f2437b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055a96b0001e4b8ca0a417671d8f2fd5'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:50.354092 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.notifications [None req-56333afc-2ac8-4d6a-b131-9fd0b1f2437b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055a96b0001e4b8ca0a417671d8f2fd5'} {{(pid=93751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:50.360100 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 635/1267] 10.222.0.36 () {58 vars in 1224 bytes} [Sat Aug 6 20:57:50 2022] DELETE /identity/v3/users/055a96b0001e4b8ca0a417671d8f2fd5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:50.551281 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d8687-a620-485f-96bb-b179b27f4688 admin admin] Authenticating user token {{(pid=93752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:50.552795 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.fernet_utils [None req-b12d8687-a620-485f-96bb-b179b27f4688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:50.570988 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d8687-a620-485f-96bb-b179b27f4688 admin admin] Validating token access rules against request {{(pid=93752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:50.628781 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247178a-a877-42fe-a00a-d6c1ab575c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d2bdc2d34c34554b4a922abe3128eee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42f40b6097a64b0993acc9ebaceea81e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:50.629428 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247178a-a877-42fe-a00a-d6c1ab575c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:50.629702 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247178a-a877-42fe-a00a-d6c1ab575c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:50.629971 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247178a-a877-42fe-a00a-d6c1ab575c2a admin admin] PATH_INFO: `/v3/projects/60fbef26bc9341b99035db68441702be` {{(pid=93752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:50.642628 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247178a-a877-42fe-a00a-d6c1ab575c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=60fbef26bc9341b99035db68441702be)` {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:50.644850 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247178a-a877-42fe-a00a-d6c1ab575c2a admin admin] RBAC: Authorization granted {{(pid=93752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:50.695412 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-5247178a-a877-42fe-a00a-d6c1ab575c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60fbef26bc9341b99035db68441702be', 'request_id': 'req-5247178a-a877-42fe-a00a-d6c1ab575c2a'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:50.705269 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-5247178a-a877-42fe-a00a-d6c1ab575c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60fbef26bc9341b99035db68441702be', 'request_id': 'req-5247178a-a877-42fe-a00a-d6c1ab575c2a'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:50.712055 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-5247178a-a877-42fe-a00a-d6c1ab575c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60fbef26bc9341b99035db68441702be', 'request_id': 'req-5247178a-a877-42fe-a00a-d6c1ab575c2a'} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:50.723620 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-5247178a-a877-42fe-a00a-d6c1ab575c2a admin admin] The token cache is being invalidate because project 60fbef26bc9341b99035db68441702be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:57:50.723919 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-5247178a-a877-42fe-a00a-d6c1ab575c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:50.724539 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG keystone.notifications [None req-5247178a-a877-42fe-a00a-d6c1ab575c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:50.726047 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: [pid: 93752|app: 0|req: 633/1268] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Aug 6 20:57:50 2022] DELETE /identity/v3/projects/60fbef26bc9341b99035db68441702be => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:00.356761 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=7,keystone:DELETE=2 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:00.720691 dv-osbrick-master-4-ceph devstack@keystone.service[93752]: DEBUG dbcounter [-] [93752] Writing DB stats keystone:SELECT=63,keystone:DELETE=11,keystone:INSERT=2 {{(pid=93752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:09.829861 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56333afc-2ac8-4d6a-b131-9fd0b1f2437b admin admin] Authenticating user token {{(pid=93751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:09.831505 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-56333afc-2ac8-4d6a-b131-9fd0b1f2437b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:09.912749 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56333afc-2ac8-4d6a-b131-9fd0b1f2437b admin admin] Validating token access rules against request {{(pid=93751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:09.978910 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c88e3-32b7-43e8-b2f7-7a9ab93d61b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47953125a0e64fef8f36c17b3504e9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce157732829848e59f95d0cd15a897eb', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:09.979528 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c88e3-32b7-43e8-b2f7-7a9ab93d61b0 service placement] REQUEST_METHOD: `GET` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:09.979855 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c88e3-32b7-43e8-b2f7-7a9ab93d61b0 service placement] SCRIPT_NAME: `/identity` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:09.980127 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c88e3-32b7-43e8-b2f7-7a9ab93d61b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:09.982064 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.fernet_utils [None req-ed4c88e3-32b7-43e8-b2f7-7a9ab93d61b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:09.993506 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c88e3-32b7-43e8-b2f7-7a9ab93d61b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:09.995130 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c88e3-32b7-43e8-b2f7-7a9ab93d61b0 service placement] RBAC: Authorization granted {{(pid=93751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:10.008304 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: [pid: 93751|app: 0|req: 636/1269] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Aug 6 21:02:09 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:02:20.001483 dv-osbrick-master-4-ceph devstack@keystone.service[93751]: DEBUG dbcounter [-] [93751] Writing DB stats keystone:SELECT=62 {{(pid=93751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}